Sep 01 00:10:02 devstack cinder-volume[76614]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 00:10:02 devstack cinder-volume[76614]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 00:10:02 devstack cinder-volume[76614]: we strongly recommend against using it for new projects. Sep 01 00:10:02 devstack cinder-volume[76614]: If you are already using Eventlet, we recommend migrating to a different Sep 01 00:10:02 devstack cinder-volume[76614]: framework. For more detail see Sep 01 00:10:02 devstack cinder-volume[76614]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 00:10:02 devstack cinder-volume[76614]: import eventlet # noqa Sep 01 00:10:06 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:10:06 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:10:06 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:10:08 devstack cinder-volume[76614]: INFO dbcounter [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Registered counter for database cinder Sep 01 00:10:08 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:10:08 devstack cinder-volume[76614]: DEBUG dbcounter [-] [76614] Writer thread running {{(pid=76614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:10:08 devstack cinder-volume[76614]: INFO cinder.rpc [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 00:10:08 devstack cinder-volume[76614]: INFO cinder.rpc [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 00:10:08 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:10:09 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Determined volume DB was empty at startup. Sep 01 00:10:09 devstack cinder-volume[76614]: DEBUG cinder.volume.manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76614) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 00:10:09 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 00:10:09 devstack cinder-volume[76614]: WARNING stevedore.named [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:10:09 devstack cinder-volume[76614]: WARNING castellan.key_manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:10:09 devstack cinder-volume[76614]: WARNING cinder.keymgr.conf_key_mgr [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:10:09 devstack cinder-volume[76614]: DEBUG cinder.volume.drivers.lvm [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76614) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 00:10:09 devstack cinder-volume[76614]: DEBUG oslo_concurrency.processutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:09 devstack cinder-volume[76614]: DEBUG oslo_concurrency.processutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] CMD "cinder-rtstool verify" returned: 0 in 0.636s {{(pid=76614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:09 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:10:09 devstack cinder-volume[76614]: INFO cinder.rpc [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 00:10:09 devstack cinder-volume[76614]: INFO cinder.rpc [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 00:10:09 devstack cinder-volume[76614]: WARNING stevedore.named [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:10:09 devstack cinder-volume[76614]: WARNING castellan.key_manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:10:09 devstack cinder-volume[76614]: INFO cinder.volume.manager [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:10:10 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Starting 1 workers Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Started child 77200 {{(pid=76614) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Full set of CONF: {{(pid=76614) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] ******************************************************************************** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Configuration options gathered from: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] ================================================================================ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] allow_availability_zone_fallback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] allow_compression_on_image_upload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] allowed_direct_url_schemes = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] api_rate_limit = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] auth_strategy = keystone {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] az_cache_duration = 3600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_host = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_stats_polling_interval = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backup_api_class = cinder.backup.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[77200]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backup_name_template = backup-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backup_use_same_host = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backup_use_temp_snapshot = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] chap_username = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_internal_tenant_project_id = 26c2eb2784534d57b5e7b1a51afb760a {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_internal_tenant_user_id = cb1914021e054ba486c46b9f8f2af883 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cloned_volume_same_az = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cluster = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] compression_format = gzip {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] compute_api_class = cinder.compute.nova.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] config_dir = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] config_source = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] control_exchange = openstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] debug = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] default_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] default_group_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] default_volume_type = lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_ssl_cert_verify = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] driver_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] enable_force_upload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] enable_new_services = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] enable_unsupported_driver = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] enforce_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_api_insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_api_ssl_compression = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_ca_certificates_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_catalog_info = image:glance:publicURL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_num_retries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance_request_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] graceful_shutdown_timeout = 5 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] group_api_class = cinder.group.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] host = devstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_compress_on_upload = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_conversion_address_space_limit = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_conversion_cpu_limit = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_conversion_disable = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_upload_use_cinder_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_upload_use_internal_tenant = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_volume_cache_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_volume_cache_max_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] image_volume_cache_max_size_gb = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] init_host_max_objects_retrieval = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] instance_format = [instance: %(uuid)s] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iscsi_target_flags = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iscsi_write_cache = on {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iser_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iser_ip_address = 192.168.122.147 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iser_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_color = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_config_append = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_options = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_rotate_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_rotate_interval_type = days {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] log_rotation_type = none {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] max_age = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] max_logfile_count = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] max_logfile_size_mb = 200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] max_over_subscription_ratio = 20.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] message_reap_interval = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] message_ttl = 2592000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] migration_create_volume_timeout_secs = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] monkey_patch = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] monkey_patch_modules = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] my_ip = 192.168.122.147 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] no_snapshot_gb_quota = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] num_iser_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] num_shell_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] num_volume_device_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] nvmeof_conn_info_version = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] nvmet_ns_id = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] nvmet_port_id = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_max_limit = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_ext_list = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_listen_port = 8776 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] osapi_volume_workers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] per_volume_size_limit = -1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] periodic_fuzzy_delay = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] periodic_interval = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] public_endpoint = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] publish_errors = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_backup_gigabytes = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_backups = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[77200]: INFO cinder.volume.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_gigabytes = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_groups = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_snapshots = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] quota_volumes = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] rate_limit_burst = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] rate_limit_except_level = CRITICAL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] rate_limit_interval = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] reinit_driver_count = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] report_discard_supported = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] report_interval = 120 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] reservation_clean_interval = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] reservation_expire = 86400 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] reserved_image_namespaces = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] reserved_percentage = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] rpc_response_timeout = 120 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] run_external_periodic_tasks = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] scst_target_driver = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_down_time = 720 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] shell_completion = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] snapshot_name_template = snapshot-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] snapshot_same_host = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] state_path = /opt/stack/data/cinder {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] storage_availability_zone = nova {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] storage_protocol = iSCSI {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] syslog_log_facility = LOG_USER {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_helper = lioadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_ip_address = 192.168.122.147 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] target_secondary_ip_addresses = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] transport_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] until_refresh = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_chap_auth = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_default_quota_class = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_journal = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_json = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_stderr = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] use_syslog = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] verify_glance_signatures = enabled {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_api_class = cinder.volume.api.API {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_clear_size = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_copy_bps_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_dd_blocksize = 1M {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_name_template = volume-%s {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_service_inithost_offload = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volume_usage_audit_period = month {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] zoning_mode = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_concurrency.disable_process_locking = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.auth_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.cache = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.include_service_catalog = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.interface = public {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcache_username = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.service_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.backend = dogpile.cache.null {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.backend_argument = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.backend_expiration_time = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.config_prefix = cache.oslo {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.debug_cache_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.enable_retry_client = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.enable_socket_keepalive = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.expiration_time = 600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.hashclient_retry_attempts = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_dead_retry = 300 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_pool_maxsize = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_sasl_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.proxies = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.redis_db = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.redis_server = localhost:6379 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.retry_attempts = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.retry_delay = 0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.socket_keepalive_count = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.socket_keepalive_idle = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.socket_keepalive_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.socket_timeout = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.tls_allowed_ciphers = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.tls_cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.tls_certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.tls_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.tls_keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cache.username = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] coordination.backend_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.asyncio_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.asyncio_slave_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.backend = sqlalchemy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.connection_debug = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.connection_parameters = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.connection_recycle_time = 3600 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.connection_trace = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.db_inc_retry_interval = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.db_max_retries = 20 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.db_max_retry_interval = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.db_retry_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.max_overflow = 50 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.max_pool_size = 5 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.max_retries = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.mysql_wsrep_sync_wait = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.pool_timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.retry_interval = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.slave_connection = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.sqlite_synchronous = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack sudo[77257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.synchronous_reader = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] database.use_db_reconnect = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack sudo[77257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_tracing.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.connection_string = messaging:// {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.es_doc_type = notification {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.es_scroll_size = 10000 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.es_scroll_time = 2m {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.filter_error_trace = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.hmac_keys = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.sentinel_service_name = mymaster {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.socket_timeout = 0.1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.trace_requests = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler.trace_sqlalchemy = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler_jaeger.process_tags = {} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler_jaeger.service_name_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] profiler_otlp.service_name_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.enforce_new_defaults = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.policy_default_rule = default {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.policy_file = policy.yaml {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.group = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.helper_command = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] privsep_osbrick.user = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.group = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.helper_command = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] cinder_sys_admin.user = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.send_service_user_token = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] service_user.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.auth_type = password {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] glance.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.chap_username = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.driver_use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.extra_capabilities = {} {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iscsi_target_flags = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iscsi_write_cache = on {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iser_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iser_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.lvm_share_target = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.lvm_type = auto {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.num_shell_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.report_discard_supported = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.reserved_percentage = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_helper = tgtadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.unique_fqdn_network = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.use_chap_auth = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_backend_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_clear_size = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_reports.file_event_handler = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_reports.log_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.backend_host = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.chap_password = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.chap_username = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.disk_geometry = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_client_cert = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.extra_capabilities = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.filter_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.goodness_function = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iser_helper = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iser_ip_address = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iser_port = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.lvm_share_target = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.lvm_type = auto {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.num_shell_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.replication_device = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.report_discard_supported = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.reserved_percentage = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.scst_target_driver = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.storage_protocol = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_helper = lioadm {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_ip_address = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_port = 3260 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.trace_flags = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.use_chap_auth = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_clear = zero {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_clear_size = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] lvmdriver-1.volumes_dir = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_notifications.driver = [] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_notifications.retry = -1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] key_manager.fixed_key = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.barbican_api_version = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.barbican_endpoint = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.barbican_endpoint_type = public {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.barbican_region_name = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.number_of_retries = 60 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.retry_delay = 1 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.send_service_user_token = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.verify_ssl = True {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican.verify_ssl_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.auth_section = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.auth_type = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.cafile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.certfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.collect_timing = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.insecure = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.keyfile = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.split_loggers = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] barbican_service_user.timeout = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.approle_role_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.approle_secret_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.auth_method = approle {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.auth_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.kv_mountpoint = secret {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.kv_path = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.kv_version = 2 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.namespace = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.root_token_id = **** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.ssl_ca_crt_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.timeout = 60.0 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.token_file = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.token_role = None {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.use_ssl = False {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:10:10 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] ******************************************************************************** {{(pid=76614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 00:10:10 devstack sudo[77257]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack sudo[77359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:10 devstack sudo[77359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:10 devstack sudo[77359]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:10:10 devstack cinder-volume[77200]: INFO cinder.brick.local_dev.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:10 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:11 devstack sudo[77463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:11 devstack sudo[77463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:11 devstack sudo[77463]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:11 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.368s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:11 devstack cinder-volume[77200]: DEBUG cinder.brick.local_dev.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77200) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 00:10:11 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:11 devstack sudo[77553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:11 devstack sudo[77553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:12 devstack sudo[77553]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.982s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:12 devstack sudo[77746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:12 devstack sudo[77746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:12 devstack sudo[77746]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:12 devstack sudo[77805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 00:10:12 devstack sudo[77805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:12 devstack sudo[77805]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.246s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:12 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:13 devstack sudo[77808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:13 devstack sudo[77808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:13 devstack sudo[77808]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:13 devstack sudo[77811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:13 devstack sudo[77811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:13 devstack sudo[77811]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:13 devstack sudo[77814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:13 devstack sudo[77814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:13 devstack sudo[77814]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:13 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:13 devstack sudo[77817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:13 devstack sudo[77817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:14 devstack sudo[77817]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack sudo[77821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:14 devstack sudo[77821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:14 devstack sudo[77821]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.236s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: INFO cinder.volume.drivers.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack sudo[77825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:14 devstack sudo[77825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:14 devstack sudo[77825]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack sudo[77828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:14 devstack sudo[77828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:14 devstack sudo[77828]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:14 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:14 devstack sudo[77836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:14 devstack sudo[77836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:15 devstack sudo[77836]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:15 devstack sudo[77839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:15 devstack sudo[77839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:15 devstack sudo[77839]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:15 devstack sudo[77842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:15 devstack sudo[77842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:15 devstack sudo[77842]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:15 devstack cinder-volume[77200]: INFO cinder.volume.driver [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Driver hasn't implemented _init_vendor_properties() Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG cinder.volume.driver [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77200) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_db.sqlalchemy.engines [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77200) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writer thread running {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG cinder.db.api [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Building query based on filter {{(pid=77200) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG cinder.image.image_utils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77200) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 00:10:15 devstack cinder-volume[77200]: INFO cinder.keymgr.migration [None req-f68d0c13-ef01-4dff-ace5-c65dcfb6d714 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:15 devstack sudo[77847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:15 devstack sudo[77847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:15 devstack sudo[77847]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:15 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:15 devstack sudo[77850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:15 devstack sudo[77850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:16 devstack sudo[77850]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:16 devstack sudo[77855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:16 devstack sudo[77855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:16 devstack sudo[77855]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:16 devstack sudo[77859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:16 devstack sudo[77859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:16 devstack sudo[77859]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG cinder.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Notifying Schedulers of capabilities ... {{(pid=77200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:10:16 devstack cinder-volume[77200]: INFO cinder.volume.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Driver initialization completed successfully. Sep 01 00:10:16 devstack cinder-volume[77200]: INFO cinder.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Initiating service 2 cleanup Sep 01 00:10:16 devstack cinder-volume[77200]: INFO cinder.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Service 2 cleanup completed. Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG cinder.service [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Creating RPC server for service cinder-volume {{(pid=77200) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG cinder.service [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77200) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 00:10:16 devstack cinder-volume[77200]: INFO cinder.volume.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:10:16 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:16 devstack sudo[77862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:10:16 devstack sudo[77862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:17 devstack sudo[77862]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:17 devstack sudo[77865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:17 devstack sudo[77865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:17 devstack sudo[77865]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:17 devstack sudo[77868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:10:17 devstack sudo[77868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:17 devstack sudo[77868]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:10:17 devstack sudo[77872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:10:17 devstack sudo[77872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:10:17 devstack sudo[77872]: pam_unix(sudo:session): session closed for user root Sep 01 00:10:17 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:10:18 devstack cinder-volume[77200]: INFO cinder.volume.manager [None req-945d5c64-b3e5-49b0-86f3-1d8599d0927b None None] Driver post RPC initialization completed successfully. Sep 01 00:10:20 devstack cinder-volume[76614]: DEBUG dbcounter [-] [76614] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:10:27 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:SELECT=4 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:10:28 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:10:46 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager._thread_info {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:10:46 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread count: 6 {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:10:46 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread info: [<_MainThread(MainThread, started 140053503606912)>, , , , , ] {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:11:46 devstack sudo[80730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:11:46 devstack sudo[80730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:11:46 devstack sudo[80730]: pam_unix(sudo:session): session closed for user root Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:11:46 devstack sudo[80870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:11:46 devstack sudo[80870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:11:46 devstack sudo[80870]: pam_unix(sudo:session): session closed for user root Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:11:46 devstack sudo[81005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:11:46 devstack sudo[81005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:11:46 devstack sudo[81005]: pam_unix(sudo:session): session closed for user root Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:11:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:11:46 devstack sudo[81143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:11:46 devstack sudo[81143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:11:47 devstack sudo[81143]: pam_unix(sudo:session): session closed for user root Sep 01 00:11:47 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:11:47 devstack cinder-volume[77200]: DEBUG cinder.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Notifying Schedulers of capabilities ... {{(pid=77200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:11:47 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager._thread_info {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:11:47 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread count: 6 {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:11:47 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread info: [<_MainThread(MainThread, started 140053503606912)>, , , , , ] {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:12:28 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:SELECT=1 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:12:28 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:UPDATE=1 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:12:46 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:12:46 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:12:46 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:12:46 devstack sudo[84357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:12:46 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:12:46 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:12:46 devstack sudo[84366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:12:46 devstack sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:12:46 devstack sudo[84366]: pam_unix(sudo:session): session closed for user root Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:12:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:12:46 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:12:46 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:12:47 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Sep 01 00:12:47 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:12:47 devstack cinder-volume[77200]: DEBUG cinder.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Notifying Schedulers of capabilities ... {{(pid=77200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:12:47 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager._thread_info {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:12:47 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread count: 6 {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:12:47 devstack cinder-volume[77200]: DEBUG cinder.volume.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] thread info: [<_MainThread(MainThread, started 140053503606912)>, , , , , ] {{(pid=77200) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_service.periodic_task [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77200) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG cinder.volume.drivers.lvm [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Updating volume stats {{(pid=77200) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:13:46 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 00:13:46 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:13:46 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:13:46 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:13:46 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:13:46 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:13:46 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 00:13:46 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:13:46 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:13:46 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:13:46 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 00:13:46 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:13:47 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Sep 01 00:13:47 devstack cinder-volume[77200]: DEBUG oslo_concurrency.processutils [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77200) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:13:47 devstack cinder-volume[77200]: DEBUG cinder.manager [None req-aa1825aa-7cc1-4e70-8d7a-ee17735bdfb4 None None] Notifying Schedulers of capabilities ... {{(pid=77200) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:14:28 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:SELECT=1 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:14:28 devstack cinder-volume[77200]: DEBUG dbcounter [-] [77200] Writing DB stats cinder:UPDATE=1 {{(pid=77200) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:14:32 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Caught SIGTERM, stopping children Sep 01 00:14:32 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Acquiring lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:32 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Acquired lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:32 devstack cinder-volume[76614]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Releasing lock "singleton_lock" {{(pid=76614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:32 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Stop services. {{(pid=76614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 00:14:32 devstack cinder-volume[76614]: DEBUG oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Killing children. {{(pid=76614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 00:14:32 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Waiting on 1 children to exit Sep 01 00:14:36 devstack cinder-volume[77200]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Acquiring lock "singleton_lock" {{(pid=77200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:36 devstack cinder-volume[77200]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Acquired lock "singleton_lock" {{(pid=77200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:36 devstack cinder-volume[77200]: DEBUG oslo_concurrency.lockutils [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Releasing lock "singleton_lock" {{(pid=77200) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:36 devstack cinder-volume[77200]: WARNING amqp [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 00:14:36 devstack cinder-volume[77200]: WARNING amqp [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 00:14:36 devstack cinder-volume[76614]: INFO oslo_service.backend._eventlet.service [None req-4a3bad6d-c4fa-4b5c-ba0e-7a59599e3686 None None] Child 77200 exited with status 0 Sep 01 00:14:37 devstack cinder-volume[86990]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 00:14:37 devstack cinder-volume[86990]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 00:14:37 devstack cinder-volume[86990]: we strongly recommend against using it for new projects. Sep 01 00:14:37 devstack cinder-volume[86990]: If you are already using Eventlet, we recommend migrating to a different Sep 01 00:14:37 devstack cinder-volume[86990]: framework. For more detail see Sep 01 00:14:37 devstack cinder-volume[86990]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 00:14:37 devstack cinder-volume[86990]: import eventlet # noqa Sep 01 00:14:39 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:39 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:39 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:39 devstack cinder-volume[86990]: INFO dbcounter [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Registered counter for database cinder Sep 01 00:14:39 devstack cinder-volume[86990]: DEBUG oslo_db.sqlalchemy.engines [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG dbcounter [-] [86990] Writer thread running {{(pid=86990) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:14:40 devstack cinder-volume[86990]: INFO cinder.rpc [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 00:14:40 devstack cinder-volume[86990]: INFO cinder.rpc [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_db.sqlalchemy.engines [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:40 devstack cinder-volume[86990]: INFO cinder.volume.manager [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Determined volume DB was empty at startup. Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG cinder.volume.manager [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86990) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 00:14:40 devstack cinder-volume[86990]: INFO cinder.volume.manager [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 00:14:40 devstack cinder-volume[86990]: WARNING stevedore.named [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:14:40 devstack cinder-volume[86990]: WARNING castellan.key_manager [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:14:40 devstack cinder-volume[86990]: WARNING cinder.keymgr.conf_key_mgr [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:14:40 devstack cinder-volume[86990]: INFO cinder.volume.manager [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_db.sqlalchemy.engines [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86990) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:40 devstack cinder-volume[86990]: INFO oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Starting 1 workers Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Started child 87207 {{(pid=86990) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Full set of CONF: {{(pid=86990) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] ******************************************************************************** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Configuration options gathered from: {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] ================================================================================ {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] allow_availability_zone_fallback = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] allow_compression_on_image_upload = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] allowed_direct_url_schemes = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] api_rate_limit = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] auth_strategy = keystone {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_availability_zone = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_host = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_stats_polling_interval = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backup_api_class = cinder.backup.api.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backup_name_template = backup-%s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backup_use_same_host = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backup_use_temp_snapshot = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] chap_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] chap_username = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_internal_tenant_project_id = 26c2eb2784534d57b5e7b1a51afb760a {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_internal_tenant_user_id = cb1914021e054ba486c46b9f8f2af883 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cluster = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] compression_format = gzip {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] compute_api_class = cinder.compute.nova.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] config_dir = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] config_source = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] control_exchange = openstack {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] debug = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] default_availability_zone = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] default_group_type = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] default_volume_type = QuobyteHD {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] disk_geometry = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_client_cert = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_client_cert_key = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_data_namespace = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_ssl_cert_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[87207]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_ssl_cert_verify = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] driver_use_ssl = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] enable_new_services = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] enable_unsupported_driver = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] enabled_backends = ['QuobyteHD'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] enforce_multipath_for_image_xfer = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] filter_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_api_insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_api_ssl_compression = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_ca_certificates_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_catalog_info = image:glance:publicURL {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_num_retries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance_request_timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] goodness_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] graceful_shutdown_timeout = 5 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] group_api_class = cinder.group.api.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] host = devstack {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_compress_on_upload = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_conversion_address_space_limit = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_conversion_cpu_limit = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_conversion_disable = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_upload_use_cinder_backend = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_upload_use_internal_tenant = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_volume_cache_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_volume_cache_max_count = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] image_volume_cache_max_size_gb = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] init_host_max_objects_retrieval = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] instance_format = [instance: %(uuid)s] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iscsi_target_flags = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iscsi_write_cache = on {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iser_helper = tgtadm {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iser_ip_address = 192.168.122.147 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iser_port = 3260 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_color = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_config_append = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_dir = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_options = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_rotate_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_rotate_interval_type = days {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] log_rotation_type = none {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] max_age = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] max_logfile_count = 30 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] max_logfile_size_mb = 200 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] max_over_subscription_ratio = 20.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] message_reap_interval = 86400 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] message_ttl = 2592000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] migration_create_volume_timeout_secs = 300 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] monkey_patch = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] monkey_patch_modules = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] my_ip = 192.168.122.147 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] no_snapshot_gb_quota = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] num_iser_scan_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] num_shell_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] num_volume_device_scan_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] nvmeof_conn_info_version = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] nvmet_ns_id = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] nvmet_port_id = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_max_limit = 1000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_ext_list = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_listen_port = 8776 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_use_ssl = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] osapi_volume_workers = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] per_volume_size_limit = -1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] periodic_fuzzy_delay = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] periodic_interval = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] public_endpoint = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] publish_errors = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_backup_gigabytes = 1000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_backups = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_gigabytes = 1000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_groups = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_snapshots = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] quota_volumes = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] rate_limit_burst = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] rate_limit_except_level = CRITICAL {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] rate_limit_interval = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] reinit_driver_count = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] replication_device = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] report_discard_supported = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] report_interval = 120 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] reservation_clean_interval = 86400 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] reservation_expire = 86400 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] reserved_image_namespaces = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] reserved_percentage = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] rpc_response_timeout = 120 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] run_external_periodic_tasks = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] scst_target_driver = iscsi {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] scst_target_iqn_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_down_time = 720 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] shell_completion = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] snapshot_name_template = snapshot-%s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] split_loggers = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] state_path = /opt/stack/data/cinder {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] storage_availability_zone = nova {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] storage_protocol = iSCSI {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] syslog_log_facility = LOG_USER {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_helper = lioadm {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_ip_address = 192.168.122.147 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_port = 3260 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.remotefs [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87207) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_protocol = iscsi {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] target_secondary_ip_addresses = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] trace_flags = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] transport_url = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] until_refresh = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_chap_auth = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_default_quota_class = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_journal = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_json = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_multipath_for_image_xfer = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_stderr = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] use_syslog = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] verify_glance_signatures = enabled {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_api_class = cinder.volume.api.API {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_backend_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_clear = zero {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_clear_ionice = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_clear_size = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_copy_bps_limit = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_dd_blocksize = 1M {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_name_template = volume-%s {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_service_inithost_offload = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volume_usage_audit_period = month {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] zoning_mode = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_concurrency.disable_process_locking = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.auth_section = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.auth_type = password {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.auth_version = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.cache = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.include_service_catalog = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.interface = public {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcache_username = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.region_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.service_type = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.backend = dogpile.cache.null {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.backend_argument = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.backend_expiration_time = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.config_prefix = cache.oslo {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.debug_cache_backend = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.enable_retry_client = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.enable_socket_keepalive = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.expiration_time = 600 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.hashclient_retry_attempts = 2 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_dead_retry = 300 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_pool_maxsize = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_sasl_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.proxies = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.redis_db = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.redis_server = localhost:6379 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.retry_attempts = 2 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.retry_delay = 0.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.socket_keepalive_count = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.socket_keepalive_idle = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.socket_keepalive_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.socket_timeout = 1.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.tls_allowed_ciphers = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.tls_cafile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.tls_certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.tls_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.tls_keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cache.username = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] coordination.backend_url = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.asyncio_connection = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.asyncio_slave_connection = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.backend = sqlalchemy {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.connection = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.connection_debug = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.connection_parameters = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.connection_recycle_time = 3600 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.connection_trace = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.db_inc_retry_interval = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.db_max_retries = 20 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.db_max_retry_interval = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.db_retry_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.max_overflow = 50 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.max_pool_size = 5 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.max_retries = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.mysql_wsrep_sync_wait = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.pool_timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.retry_interval = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.slave_connection = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.sqlite_synchronous = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.synchronous_reader = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] database.use_db_reconnect = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_tracing.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.connection_string = messaging:// {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.es_doc_type = notification {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.es_scroll_size = 10000 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.es_scroll_time = 2m {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.filter_error_trace = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.hmac_keys = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.sentinel_service_name = mymaster {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.socket_timeout = 0.1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.trace_requests = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler.trace_sqlalchemy = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler_jaeger.process_tags = {} {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler_jaeger.service_name_prefix = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] profiler_otlp.service_name_prefix = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.enforce_new_defaults = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.policy_default_rule = default {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.policy_file = policy.yaml {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87207) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 00:14:40 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 00:14:40 devstack cinder-volume[87207]: WARNING cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.group = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.helper_command = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Running cmd (subprocess): mount.quobyte {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] privsep_osbrick.user = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.group = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.helper_command = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] cinder_sys_admin.user = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.auth_section = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.auth_type = password {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.cafile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.collect_timing = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.send_service_user_token = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.split_loggers = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] service_user.timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.auth_section = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.auth_type = password {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.collect_timing = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.region_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.split_loggers = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] glance.timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.backend_availability_zone = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.chap_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.chap_username = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.disk_geometry = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_client_cert = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_client_cert_key = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_data_namespace = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.driver_use_ssl = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.extra_capabilities = {} {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.filter_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.goodness_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iscsi_target_flags = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iscsi_write_cache = on {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iser_helper = tgtadm {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iser_port = 3260 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_host = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_login = admin {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_mount_options = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_private_key = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_share_path = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.num_shell_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.quobyte_volume_url = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.replication_device = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.report_discard_supported = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.reserved_percentage = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_helper = tgtadm {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_port = 3260 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_protocol = iscsi {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.trace_flags = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.unique_fqdn_network = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.use_chap_auth = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_backend_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_clear = zero {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_clear_ionice = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_clear_size = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_reports.file_event_handler = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_reports.log_dir = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.backend_availability_zone = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.backend_host = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.chap_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.chap_username = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.chiscsi_conf = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.disk_geometry = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_client_cert = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_data_namespace = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.driver_use_ssl = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.extra_capabilities = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.filter_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.goodness_function = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iser_helper = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iser_ip_address = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iser_port = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.iser_target_prefix = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_host = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_login = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_mount_options = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_password = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_private_key = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_share_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_ssh_port = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.num_shell_tries = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.nvmet_port_id = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.replication_device = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.report_discard_supported = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.reserved_percentage = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.scst_target_driver = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.storage_protocol = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_helper = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_ip_address = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_port = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_prefix = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_protocol = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.trace_flags = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.use_chap_auth = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:40 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_clear = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_clear_size = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] QuobyteHD.volumes_dir = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack quobyte-client[87208]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 00:14:41 devstack quobyte-client[87208]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] CMD "mount.quobyte" returned: 1 in 0.180s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_notifications.driver = [] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_notifications.retry = -1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] key_manager.fixed_key = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[87207]: INFO cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 ... Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f -c /etc/quobyte/client-cinder.cfg {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.barbican_api_version = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.barbican_endpoint = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.barbican_endpoint_type = public {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.barbican_region_name = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.cafile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.collect_timing = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.number_of_retries = 60 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.retry_delay = 1 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.send_service_user_token = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.split_loggers = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.verify_ssl = True {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican.verify_ssl_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.auth_section = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.auth_type = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.cafile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.certfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.collect_timing = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.insecure = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.keyfile = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.split_loggers = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] barbican_service_user.timeout = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.approle_role_id = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.approle_secret_id = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.auth_method = approle {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.auth_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.kv_mountpoint = secret {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.kv_path = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.kv_version = 2 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.namespace = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.root_token_id = **** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.ssl_ca_crt_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.timeout = 60.0 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.token_file = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.token_role = None {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.use_ssl = False {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:41 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] ******************************************************************************** {{(pid=86990) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 00:14:41 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f -c /etc/quobyte/client-cinder.cfg Sep 01 00:14:41 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:41 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.421s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:41 devstack cinder-volume[87207]: INFO cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 succeeded Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.441s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:41 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:41 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:41 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.248s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:41 devstack cinder-volume[87207]: INFO cinder.volume.driver [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.volume.driver [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3857078552246, 'free_capacity_gb': 1774.3857078552246, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writer thread running {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.db.api [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Building query based on filter {{(pid=87207) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.image.image_utils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 00:14:41 devstack cinder-volume[87207]: INFO cinder.keymgr.migration [None req-2fcaa33f-40e4-4ec0-9432-55a18e5b29af None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:41 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:41 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:41 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:42 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.278s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:14:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Driver initialization completed successfully. Sep 01 00:14:42 devstack cinder-volume[87207]: INFO cinder.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Initiating service 3 cleanup Sep 01 00:14:42 devstack cinder-volume[87207]: INFO cinder.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Service 3 cleanup completed. Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG cinder.service [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Creating RPC server for service cinder-volume {{(pid=87207) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG cinder.service [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87207) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 00:14:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:42 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:42 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:42 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:42 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.370s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:42 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-bc6d4d3b-009f-4400-85c4-3cd59bac9a44 None None] Driver post RPC initialization completed successfully. Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG cinder.volume.drivers.quobyte [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87207) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:46 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:46 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:46 devstack cinder-volume[86990]: INFO oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Caught SIGTERM, stopping children Sep 01 00:14:46 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Acquiring lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:46 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Acquired lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:46 devstack cinder-volume[86990]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Releasing lock "singleton_lock" {{(pid=86990) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:46 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Stop services. {{(pid=86990) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 00:14:46 devstack cinder-volume[86990]: DEBUG oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Killing children. {{(pid=86990) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 00:14:46 devstack cinder-volume[86990]: INFO oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Waiting on 1 children to exit Sep 01 00:14:46 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG oslo_concurrency.processutils [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.336s {{(pid=87207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:46 devstack cinder-volume[87207]: DEBUG cinder.manager [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Notifying Schedulers of capabilities ... {{(pid=87207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo.messaging._drivers.impl_rabbit [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Unable to connect to AMQP server on 192.168.122.147:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server [None req-adad474b-2c48-4b2e-a564-7cc67c17c645 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.147:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server method() Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return _publish( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server listener(*args) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.147:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 01 00:14:46 devstack cinder-volume[87207]: ERROR oslo_messaging.rpc.server Sep 01 00:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Acquiring lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Acquired lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:50 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Releasing lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:50 devstack cinder-volume[87207]: WARNING amqp [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 00:14:50 devstack cinder-volume[87207]: WARNING amqp [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 00:14:50 devstack cinder-volume[86990]: INFO oslo_service.backend._eventlet.service [None req-d9181fa5-f82f-474d-900b-45ef937b6809 None None] Child 87207 exited with status 0 Sep 01 00:14:51 devstack cinder-volume[87497]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 00:14:51 devstack cinder-volume[87497]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 00:14:51 devstack cinder-volume[87497]: we strongly recommend against using it for new projects. Sep 01 00:14:51 devstack cinder-volume[87497]: If you are already using Eventlet, we recommend migrating to a different Sep 01 00:14:51 devstack cinder-volume[87497]: framework. For more detail see Sep 01 00:14:51 devstack cinder-volume[87497]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 00:14:51 devstack cinder-volume[87497]: import eventlet # noqa Sep 01 00:14:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 00:14:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 00:14:54 devstack cinder-volume[87497]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 00:14:54 devstack cinder-volume[87497]: INFO dbcounter [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Registered counter for database cinder Sep 01 00:14:54 devstack cinder-volume[87497]: DEBUG oslo_db.sqlalchemy.engines [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writer thread running {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:14:55 devstack cinder-volume[87497]: INFO cinder.rpc [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 00:14:55 devstack cinder-volume[87497]: INFO cinder.rpc [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_db.sqlalchemy.engines [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Determined volume DB was empty at startup. Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG cinder.volume.manager [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87497) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 00:14:55 devstack cinder-volume[87497]: WARNING stevedore.named [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 00:14:55 devstack cinder-volume[87497]: WARNING castellan.key_manager [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:14:55 devstack cinder-volume[87497]: WARNING cinder.keymgr.conf_key_mgr [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 00:14:55 devstack cinder-volume[87497]: INFO cinder.volume.manager [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_db.sqlalchemy.engines [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:55 devstack cinder-volume[87497]: INFO oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Starting 1 workers Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Started child 87803 {{(pid=87497) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Full set of CONF: {{(pid=87497) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] ******************************************************************************** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] Configuration options gathered from: {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] ================================================================================ {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] allow_availability_zone_fallback = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] allow_compression_on_image_upload = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] allowed_direct_url_schemes = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] api_rate_limit = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] auth_strategy = keystone {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_availability_zone = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_host = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_stats_polling_interval = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backup_api_class = cinder.backup.api.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backup_name_template = backup-%s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backup_use_same_host = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backup_use_temp_snapshot = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] chap_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] chap_username = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_internal_tenant_project_id = 26c2eb2784534d57b5e7b1a51afb760a {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_internal_tenant_user_id = cb1914021e054ba486c46b9f8f2af883 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cluster = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] compression_format = gzip {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] compute_api_class = cinder.compute.nova.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] config_dir = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] config_source = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] control_exchange = openstack {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] debug = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] default_availability_zone = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] default_group_type = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] default_volume_type = QuobyteHD {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] disk_geometry = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_client_cert = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_client_cert_key = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_data_namespace = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_ssl_cert_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_ssl_cert_verify = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] driver_use_ssl = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87803]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] enable_new_services = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] enable_unsupported_driver = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] enabled_backends = ['QuobyteHD'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] enforce_multipath_for_image_xfer = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] filter_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_api_insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_api_servers = ['http://192.168.122.147/image'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_api_ssl_compression = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_ca_certificates_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_catalog_info = image:glance:publicURL {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_num_retries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance_request_timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] goodness_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] graceful_shutdown_timeout = 5 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] group_api_class = cinder.group.api.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] host = devstack {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_compress_on_upload = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_conversion_address_space_limit = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_conversion_cpu_limit = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_conversion_disable = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_upload_use_cinder_backend = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_upload_use_internal_tenant = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_volume_cache_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_volume_cache_max_count = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] image_volume_cache_max_size_gb = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] init_host_max_objects_retrieval = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] instance_format = [instance: %(uuid)s] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iscsi_target_flags = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iscsi_write_cache = on {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iser_helper = tgtadm {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iser_ip_address = 192.168.122.147 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iser_port = 3260 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_color = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_config_append = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_dir = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_options = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_rotate_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_rotate_interval_type = days {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] log_rotation_type = none {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] max_age = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] max_logfile_count = 30 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] max_logfile_size_mb = 200 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] max_over_subscription_ratio = 20.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] message_reap_interval = 86400 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] message_ttl = 2592000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] migration_create_volume_timeout_secs = 300 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] monkey_patch = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] monkey_patch_modules = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] my_ip = 192.168.122.147 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] no_snapshot_gb_quota = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] num_iser_scan_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] num_shell_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] num_volume_device_scan_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] nvmeof_conn_info_version = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] nvmet_ns_id = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] nvmet_port_id = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_max_limit = 1000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_ext_list = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_listen = 0.0.0.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_listen_port = 8776 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_use_ssl = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] osapi_volume_workers = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] per_volume_size_limit = -1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87803) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] periodic_fuzzy_delay = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] periodic_interval = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] project_id_regex = [0-9a-f\-]+ {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] public_endpoint = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] publish_errors = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_backup_gigabytes = 1000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_backups = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_gigabytes = 1000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_groups = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_snapshots = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] quota_volumes = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] rate_limit_burst = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] rate_limit_except_level = CRITICAL {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] rate_limit_interval = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] reinit_driver_count = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] replication_device = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] report_discard_supported = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] report_interval = 120 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] reservation_clean_interval = 86400 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] reservation_expire = 86400 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] reserved_image_namespaces = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] reserved_percentage = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] rpc_response_timeout = 120 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] run_external_periodic_tasks = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] scst_target_driver = iscsi {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] scst_target_iqn_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_down_time = 720 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] shell_completion = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] snapshot_name_template = snapshot-%s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] split_loggers = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] state_path = /opt/stack/data/cinder {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] storage_availability_zone = nova {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] storage_protocol = iSCSI {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] syslog_log_facility = LOG_USER {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_helper = lioadm {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_ip_address = 192.168.122.147 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_port = 3260 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_protocol = iscsi {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] target_secondary_ip_addresses = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] trace_flags = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] transfer_api_class = cinder.transfer.api.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] transport_url = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] until_refresh = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_chap_auth = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_default_quota_class = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_journal = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_json = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_multipath_for_image_xfer = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_stderr = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] use_syslog = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] verify_glance_signatures = enabled {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_api_class = cinder.volume.api.API {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_backend_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_clear = zero {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_clear_ionice = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_clear_size = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_copy_bps_limit = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_dd_blocksize = 1M {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_name_template = volume-%s {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_service_inithost_offload = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volume_usage_audit_period = month {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] zoning_mode = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_concurrency.disable_process_locking = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.auth_section = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.auth_type = password {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.auth_version = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.cache = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.delay_auth_decision = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.http_connect_timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.include_service_catalog = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.interface = public {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcache_username = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.region_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.service_token_roles_required = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.service_type = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.token_cache_time = 300 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.147/identity {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.backend = dogpile.cache.null {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.backend_argument = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87803) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 00:14:55 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 00:14:55 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.backend_expiration_time = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.config_prefix = cache.oslo {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.debug_cache_backend = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.enable_retry_client = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.enable_socket_keepalive = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.expiration_time = 600 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Running cmd (subprocess): mount.quobyte {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.hashclient_retry_attempts = 2 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_dead_retry = 300 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_pool_maxsize = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_sasl_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.proxies = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.redis_db = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.redis_sentinel_service_name = mymaster {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.redis_server = localhost:6379 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.retry_attempts = 2 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.retry_delay = 0.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.socket_keepalive_count = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.socket_keepalive_idle = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.socket_keepalive_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.socket_timeout = 1.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.tls_allowed_ciphers = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.tls_cafile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.tls_certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.tls_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.tls_keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cache.username = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] coordination.backend_url = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.asyncio_connection = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.asyncio_slave_connection = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.backend = sqlalchemy {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.connection = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.connection_debug = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.connection_parameters = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.connection_recycle_time = 3600 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.connection_trace = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.db_inc_retry_interval = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.db_max_retries = 20 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.db_max_retry_interval = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.db_retry_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.max_overflow = 50 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.max_pool_size = 5 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.max_retries = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.mysql_wsrep_sync_wait = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.pool_timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.retry_interval = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.slave_connection = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.sqlite_synchronous = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.synchronous_reader = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] database.use_db_reconnect = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_tracing.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.connection_string = messaging:// {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.es_doc_type = notification {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.es_scroll_size = 10000 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.es_scroll_time = 2m {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.filter_error_trace = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.hmac_keys = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.sentinel_service_name = mymaster {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.socket_timeout = 0.1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.trace_requests = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler.trace_sqlalchemy = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler_jaeger.process_tags = {} {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler_jaeger.service_name_prefix = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] profiler_otlp.service_name_prefix = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.enforce_new_defaults = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.policy_default_rule = default {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.policy_file = policy.yaml {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_policy.remote_timeout = 60.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.group = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.helper_command = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] privsep_osbrick.user = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.group = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.helper_command = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack quobyte-client[87804]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 00:14:55 devstack quobyte-client[87804]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] cinder_sys_admin.user = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.auth_section = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.auth_type = password {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.cafile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.collect_timing = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.send_service_user_token = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.split_loggers = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] service_user.timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.auth_section = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.auth_type = password {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.collect_timing = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.region_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.split_loggers = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] glance.timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.backend_availability_zone = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.chap_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.chap_username = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.disk_geometry = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_client_cert = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_client_cert_key = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_data_namespace = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.driver_use_ssl = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.enable_unsupported_driver = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.extra_capabilities = {} {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.filter_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.goodness_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iscsi_target_flags = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iscsi_write_cache = on {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iser_helper = tgtadm {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iser_ip_address = 192.168.122.147 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iser_port = 3260 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_host = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_login = admin {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_mount_options = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_private_key = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_share_path = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_ssh_port = 22 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.num_shell_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.nvmet_port_id = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_client_cfg = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.quobyte_volume_url = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.replication_device = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.report_discard_supported = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.reserved_percentage = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.scst_target_driver = iscsi {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.scst_target_iqn_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.storage_protocol = iSCSI {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_helper = tgtadm {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_ip_address = 192.168.122.147 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_port = 3260 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_protocol = iscsi {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.trace_flags = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.unique_fqdn_network = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.use_chap_auth = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_backend_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_clear = zero {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_clear_ionice = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_clear_size = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_reports.file_event_handler = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_reports.log_dir = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.backend_availability_zone = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.backend_host = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.chap_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.chap_username = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.chiscsi_conf = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.disk_geometry = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_client_cert = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_client_cert_key = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_data_namespace = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.driver_use_ssl = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.extra_capabilities = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.filter_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.goodness_function = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iscsi_target_flags = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iscsi_write_cache = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iser_helper = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iser_ip_address = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iser_port = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.iser_target_prefix = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_host = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_login = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_mount_options = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_password = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_private_key = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_share_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_ssh_port = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.num_shell_tries = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nvmet_ns_id = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.nvmet_port_id = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.replication_device = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.report_discard_supported = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.reserved_percentage = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.scst_target_driver = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.storage_protocol = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_helper = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_ip_address = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_port = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_prefix = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_protocol = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.trace_flags = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.unique_fqdn_network = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.use_chap_auth = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_clear = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_clear_ionice = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_clear_size = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] QuobyteHD.volumes_dir = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.ssl_version = {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_notifications.driver = [] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_notifications.retry = -1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] oslo_messaging_notifications.transport_url = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] key_manager.fixed_key = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.barbican_api_version = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.barbican_endpoint = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.barbican_endpoint_type = public {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.barbican_region_name = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.cafile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.collect_timing = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.number_of_retries = 60 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.retry_delay = 1 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.send_service_user_token = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.split_loggers = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.verify_ssl = True {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican.verify_ssl_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.auth_section = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.auth_type = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.cafile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.certfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.collect_timing = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.insecure = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.keyfile = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.split_loggers = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] barbican_service_user.timeout = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.approle_role_id = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.approle_secret_id = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.auth_method = approle {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.auth_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.kv_mountpoint = secret {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.kv_path = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.kv_version = 2 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.namespace = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.root_token_id = **** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.ssl_ca_crt_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.timeout = 60.0 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.token_file = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.token_role = None {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.use_ssl = False {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 00:14:55 devstack cinder-volume[87497]: DEBUG oslo_service.backend._eventlet.service [None req-60d3e5f7-6b49-4afa-9447-2f61769b3dca None None] ******************************************************************************** {{(pid=87497) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 00:14:55 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.269s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:55 devstack cinder-volume[87803]: INFO cinder.volume.driver [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.driver [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3857078552246, 'free_capacity_gb': 1774.3857078552246, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87803) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_db.sqlalchemy.engines [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87803) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writer thread running {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.db.api [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Building query based on filter {{(pid=87803) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87803) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:55 devstack cinder-volume[87803]: INFO cinder.keymgr.migration [None req-d1e56d0f-aba9-4016-a9a1-bf5b2b29a927 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 00:14:55 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:55 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:56 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.235s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:14:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Driver initialization completed successfully. Sep 01 00:14:56 devstack cinder-volume[87803]: INFO cinder.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Initiating service 3 cleanup Sep 01 00:14:56 devstack cinder-volume[87803]: INFO cinder.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Service 3 cleanup completed. Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG cinder.service [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Creating RPC server for service cinder-volume {{(pid=87803) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG cinder.service [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87803) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 00:14:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:14:56 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:14:56 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:14:56 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Sep 01 00:14:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.234s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:14:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-370ec62b-53ba-4563-9615-c5323fecb7f9 None None] Driver post RPC initialization completed successfully. Sep 01 00:15:05 devstack cinder-volume[87497]: DEBUG dbcounter [-] [87497] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:15:06 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=2 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:15:06 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:15:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:15:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 6 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:15:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Flow 'volume_create_manager' (2a425166-2982-4244-972b-1711e364a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2c1b6-c641-40a2-98f7-42f3437dae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2c1b6-c641-40a2-98f7-42f3437dae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1198362870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb023d1-9d28-4fb3-9711-666395494a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f25b043dc745139374e8d398bf2cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:15:58Z,use_quota=True,user_id='352fe7773ab34b6a8a6964898715600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fbac91-88a8-43fc-96e6-8ad2d7df6875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fbac91-88a8-43fc-96e6-8ad2d7df6875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945c87ff-ddba-4ec2-9c8f-b57544d4af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945c87ff-ddba-4ec2-9c8f-b57544d4af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb023d1-9d28-4fb3-9711-666395494a16', 'volume_name': 'volume-afb023d1-9d28-4fb3-9711-666395494a16', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d381e8-c722-49f2-8552-7f78c82a61a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d381e8-c722-49f2-8552-7f78c82a61a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29396521-b7a4-4bfe-a7c5-3aec8920754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Volume afb023d1-9d28-4fb3-9711-666395494a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb023d1-9d28-4fb3-9711-666395494a16', 'volume_size': 1} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1198362870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb023d1-9d28-4fb3-9711-666395494a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f25b043dc745139374e8d398bf2cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:15:58Z,use_quota=True,user_id='352fe7773ab34b6a8a6964898715600c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Creating volume afb023d1-9d28-4fb3-9711-666395494a16 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:15:57 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:15:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:15:57 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 1073741824 Sep 01 00:15:57 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:15:58 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Sep 01 00:15:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 1073741824" returned: 0 in 0.614s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:15:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:15:58 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 Sep 01 00:15:58 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:15:58 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Sep 01 00:15:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16" returned: 0 in 0.531s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:15:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:15:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:15:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29396521-b7a4-4bfe-a7c5-3aec8920754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb023d1-9d28-4fb3-9711-666395494a16', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4848ce-4790-4afa-838d-7ef1443a8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:15:59 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Volume volume-afb023d1-9d28-4fb3-9711-666395494a16 (afb023d1-9d28-4fb3-9711-666395494a16): created successfully Sep 01 00:15:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4848ce-4790-4afa-838d-7ef1443a8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:15:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Flow 'volume_create_manager' (2a425166-2982-4244-972b-1711e364a841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:15:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-565ab0ba-b2b4-40e7-900b-cae5176357d2 tempest-TaggedAttachmentsTest-1115928451 None] Created volume successfully. Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Flow 'volume_create_manager' (148fb1c1-ba02-4c66-98b9-14d4f43d5d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe2e03-51d6-4084-8ea9-80a92140ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fe2e03-51d6-4084-8ea9-80a92140ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1936388910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2279b074-bdcf-46ff-ba1f-1442c7306159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5257795ffb2542fbb15234913dbc5132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:07Z,use_quota=True,user_id='045e4914bbac4481b57e406a1a9773e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c9d62-2a64-4254-9b31-3c86fa375a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c9d62-2a64-4254-9b31-3c86fa375a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfe476-e935-43d1-be24-24d042a5837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bfe476-e935-43d1-be24-24d042a5837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2279b074-bdcf-46ff-ba1f-1442c7306159', 'volume_name': 'volume-2279b074-bdcf-46ff-ba1f-1442c7306159', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe0883-a8d1-488a-bed6-d7483c6d5861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe0883-a8d1-488a-bed6-d7483c6d5861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b328607-9954-4f0a-881b-fc3531c7ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Volume 2279b074-bdcf-46ff-ba1f-1442c7306159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2279b074-bdcf-46ff-ba1f-1442c7306159', 'volume_size': 1} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1936388910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2279b074-bdcf-46ff-ba1f-1442c7306159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5257795ffb2542fbb15234913dbc5132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:07Z,use_quota=True,user_id='045e4914bbac4481b57e406a1a9773e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Creating volume 2279b074-bdcf-46ff-ba1f-1442c7306159 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:16:07 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:16:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:07 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 1073741824 Sep 01 00:16:07 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:08 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 1073741824" returned: 0 in 1.125s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:09 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 Sep 01 00:16:09 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:09 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159" returned: 0 in 0.801s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b328607-9954-4f0a-881b-fc3531c7ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2279b074-bdcf-46ff-ba1f-1442c7306159', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb196cdb-ad06-415b-954a-fc6e4856a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Volume volume-2279b074-bdcf-46ff-ba1f-1442c7306159 (2279b074-bdcf-46ff-ba1f-1442c7306159): created successfully Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb196cdb-ad06-415b-954a-fc6e4856a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Flow 'volume_create_manager' (148fb1c1-ba02-4c66-98b9-14d4f43d5d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-61597cd1-8e1b-4137-b137-d57a090bc0c8 tempest-DeleteServersTestJSON-465687576 None] Created volume successfully. Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:13 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:16:13 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:14 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.664s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:16:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:16:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 6 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:16:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:16:17 devstack cinder-volume[87803]: WARNING py.warnings [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 01 00:16:17 devstack cinder-volume[87803]: .first() Sep 01 00:16:17 devstack cinder-volume[87803]: Sep 01 00:16:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-2279b074-bdcf-46ff-ba1f-1442c7306159', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '272afff6-ebbf-48c8-9bbb-9fda9ff02065', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:16:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-500b70ca-5c99-47ab-b6bb-9e54635da78f req-7d875a04-1192-400e-93e8-4863eab76ecd tempest-DeleteServersTestJSON-465687576 None] attachment_update completed successfully. Sep 01 00:16:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-3ca0ea02-71d5-4431-b638-ef958d2d95cd req-db3df779-59bd-431c-b3bf-a4fbea672309 tempest-DeleteServersTestJSON-465687576 None] Terminate volume connection completed successfully. Sep 01 00:16:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-3ca0ea02-71d5-4431-b638-ef958d2d95cd req-db3df779-59bd-431c-b3bf-a4fbea672309 tempest-DeleteServersTestJSON-465687576 None] Deleting attachment 272afff6-ebbf-48c8-9bbb-9fda9ff02065. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:16:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "cinder-2279b074-bdcf-46ff-ba1f-1442c7306159-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "cinder-2279b074-bdcf-46ff-ba1f-1442c7306159-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "cinder-quobyte-2279b074-bdcf-46ff-ba1f-1442c7306159" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "cinder-quobyte-2279b074-bdcf-46ff-ba1f-1442c7306159" acquired by "delete_volume" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:30 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp244odesh/privsep.sock'] Sep 01 00:16:30 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp244odesh/privsep.sock Sep 01 00:16:30 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 00:16:31 devstack cinder-volume[87803]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 00:16:32 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:32 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Spawned new privsep daemon via rootwrap Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Accepted privsep connection to /tmp/tmp244odesh/privsep.sock {{(pid=87803) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 00:16:32 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 00:16:32 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 00:16:32 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 00:16:32 devstack cinder-volume[87803]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89587 Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac313c-fed0-474c-a0fc-99e4b426e5f9]: (2,) {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503ae67-4de0-49a0-afd6-41e04a37b497]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:32 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 Sep 01 00:16:32 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:32 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159" returned: 0 in 0.402s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:32 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159 Sep 01 00:16:32 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:32 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2279b074-bdcf-46ff-ba1f-1442c7306159" returned: 0 in 0.330s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "cinder-quobyte-2279b074-bdcf-46ff-ba1f-1442c7306159" released by "delete_volume" :: held 2.799s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:32 devstack cinder-volume[87803]: WARNING cinder.quota [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:16:32 devstack cinder-volume[87803]: WARNING cinder.quota [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Created reservations ['31942589-c8f7-4174-9b72-8e5da8600c41', '10cd6bf6-49a3-433b-bc53-b97da3812474', '561cb38c-6d8d-4a7d-9347-4e6eb28a993b', 'e8805947-2778-4ce2-a621-dc7d80effe6a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:33 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:16:33 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:33 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.428s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:16:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Deleted volume successfully. Sep 01 00:16:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-726cbb2d-1e63-48c8-9573-d4293adfd7d5 tempest-DeleteServersTestJSON-465687576 None] Lock "cinder-2279b074-bdcf-46ff-ba1f-1442c7306159-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Flow 'volume_create_manager' (7d1e535a-aa19-4ea9-bcbc-99a8a7111d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6738b8-ca40-465b-be54-f5474760a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6738b8-ca40-465b-be54-f5474760a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-215947662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa113aba-f5ba-4f13-9e1b-d26845fb3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc3043ce8e4fb6b5763fa75b833371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:34Z,use_quota=True,user_id='e8339b55d25a489bba70f84b670d7dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50c4a57-839d-41f4-bcd0-c7d7fd52b8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d50c4a57-839d-41f4-bcd0-c7d7fd52b8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a03bd-8975-4dfe-aab3-77c2bd93768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a03bd-8975-4dfe-aab3-77c2bd93768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa113aba-f5ba-4f13-9e1b-d26845fb3f7f', 'volume_name': 'volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97625b56-d67d-46a1-8af1-300ed78fda38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97625b56-d67d-46a1-8af1-300ed78fda38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaebe77-c0b0-42fd-b88c-a0c94a392e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Volume fa113aba-f5ba-4f13-9e1b-d26845fb3f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f', 'volume_size': 1} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-215947662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa113aba-f5ba-4f13-9e1b-d26845fb3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc3043ce8e4fb6b5763fa75b833371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:34Z,use_quota=True,user_id='e8339b55d25a489bba70f84b670d7dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Creating volume fa113aba-f5ba-4f13-9e1b-d26845fb3f7f {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:16:34 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:16:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:34 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f 1073741824 Sep 01 00:16:34 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:35 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f 1073741824" returned: 0 in 0.651s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:35 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f Sep 01 00:16:35 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:35 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaebe77-c0b0-42fd-b88c-a0c94a392e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a2c4a7-2286-4644-a133-df29ed8164c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:35 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Volume volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f (fa113aba-f5ba-4f13-9e1b-d26845fb3f7f): created successfully Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a2c4a7-2286-4644-a133-df29ed8164c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Flow 'volume_create_manager' (7d1e535a-aa19-4ea9-bcbc-99a8a7111d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-522220d0-83b2-4c86-ba17-520dfe2087f2 tempest-ServersNegativeTestJSON-1730726344 None] Created volume successfully. Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Flow 'volume_create_manager' (060bcd7e-9e03-44d4-856c-11ff4fe215ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfab1f6e-9207-4812-81bf-d959f60e8afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfab1f6e-9207-4812-81bf-d959f60e8afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1151511733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6420be-2737-4199-b008-d57e7c266063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc3043ce8e4fb6b5763fa75b833371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:42Z,use_quota=True,user_id='e8339b55d25a489bba70f84b670d7dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace9f6c-7781-4d97-ba80-5a6458c54e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ace9f6c-7781-4d97-ba80-5a6458c54e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6b7859-5f66-4bd3-9cee-11f2afff0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6b7859-5f66-4bd3-9cee-11f2afff0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6420be-2737-4199-b008-d57e7c266063', 'volume_name': 'volume-8d6420be-2737-4199-b008-d57e7c266063', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e65658a-c8c0-4359-b5cd-4325d8262fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e65658a-c8c0-4359-b5cd-4325d8262fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbb6529-54e3-47ce-ad0c-1b8a768b7c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Volume 8d6420be-2737-4199-b008-d57e7c266063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6420be-2737-4199-b008-d57e7c266063', 'volume_size': 1} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1151511733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6420be-2737-4199-b008-d57e7c266063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc3043ce8e4fb6b5763fa75b833371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:16:42Z,use_quota=True,user_id='e8339b55d25a489bba70f84b670d7dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Creating volume 8d6420be-2737-4199-b008-d57e7c266063 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:16:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:16:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:41 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 1073741824 Sep 01 00:16:41 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:42 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 1073741824" returned: 0 in 0.569s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:42 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 Sep 01 00:16:42 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:42 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbb6529-54e3-47ce-ad0c-1b8a768b7c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6420be-2737-4199-b008-d57e7c266063', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770590a0-bbf3-470c-85ee-caaea5045107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:16:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Volume volume-8d6420be-2737-4199-b008-d57e7c266063 (8d6420be-2737-4199-b008-d57e7c266063): created successfully Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770590a0-bbf3-470c-85ee-caaea5045107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:16:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Flow 'volume_create_manager' (060bcd7e-9e03-44d4-856c-11ff4fe215ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:16:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-64d41d4b-f6ad-4ebc-8966-d04dd9bc1c37 tempest-ServersNegativeTestJSON-1730726344 None] Created volume successfully. Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "cinder-8d6420be-2737-4199-b008-d57e7c266063-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-8d6420be-2737-4199-b008-d57e7c266063-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "cinder-quobyte-8d6420be-2737-4199-b008-d57e7c266063" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-quobyte-8d6420be-2737-4199-b008-d57e7c266063" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78db2c-6eb8-4fc4-90fd-9b0421e3638a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:44 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 Sep 01 00:16:44 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:44 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:44 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063 Sep 01 00:16:44 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:45 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8d6420be-2737-4199-b008-d57e7c266063" returned: 0 in 0.326s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-quobyte-8d6420be-2737-4199-b008-d57e7c266063" released by "delete_volume" :: held 0.794s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Created reservations ['9f86bf16-1ae2-41a9-b787-894526c3d418', '94af3eb5-96c8-467b-bbdb-90a88c64c9da', '1d0d871d-d4fa-4d73-93ce-22eef49f85b7', 'bb0a8321-4b04-4c35-a613-a30629891fa4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:45 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:16:45 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "cinder-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "cinder-quobyte-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-quobyte-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b486de5-40f7-4814-9a8a-d22960e075bc]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:45 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:16:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Deleted volume successfully. Sep 01 00:16:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9042f248-94a7-4dde-93d9-99fd02413e7c tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-8d6420be-2737-4199-b008-d57e7c266063-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:45 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f Sep 01 00:16:45 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:46 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" returned: 0 in 0.485s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:46 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f Sep 01 00:16:46 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:46 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" returned: 0 in 0.487s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-quobyte-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f" released by "delete_volume" :: held 1.047s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Created reservations ['a09045ce-60c7-4d22-b0d5-63f1b996384e', '9ed0c247-8c00-45f8-9d89-fd0a6512e5ed', 'eef32a7a-0164-4e9c-a4e8-acfde0cf2b41', 'e53014d9-bd52-49f3-a239-3f6f66665eee'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:16:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:16:46 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:16:46 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:16:47 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Sep 01 00:16:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:16:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:16:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Deleted volume successfully. Sep 01 00:16:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3ad0908d-4e6e-4b5d-9d6c-b4b2f47bdb8a tempest-ServersNegativeTestJSON-1730726344 None] Lock "cinder-fa113aba-f5ba-4f13-9e1b-d26845fb3f7f-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:16:56 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=27,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:16:56 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=36,cinder:SELECT=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:13 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:17:13 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:14 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.696s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6785985f-388b-41dc-a5b9-b848cb318b3f req-84c7449b-722a-46b7-8407-c4a0e3c17f3c tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6785985f-388b-41dc-a5b9-b848cb318b3f req-84c7449b-722a-46b7-8407-c4a0e3c17f3c tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6785985f-388b-41dc-a5b9-b848cb318b3f req-84c7449b-722a-46b7-8407-c4a0e3c17f3c tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-6785985f-388b-41dc-a5b9-b848cb318b3f req-84c7449b-722a-46b7-8407-c4a0e3c17f3c tempest-TaggedAttachmentsTest-1115928451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-afb023d1-9d28-4fb3-9711-666395494a16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4193362c-97ab-40a3-80e0-157528212bdd', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:17:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-6785985f-388b-41dc-a5b9-b848cb318b3f req-84c7449b-722a-46b7-8407-c4a0e3c17f3c tempest-TaggedAttachmentsTest-1115928451 None] attachment_update completed successfully. Sep 01 00:17:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-1872752f-c20d-4375-a605-9884c3d200fd req-4c2e34de-4c88-4f1c-b276-eade0de0db04 tempest-TaggedAttachmentsTest-1115928451 None] Terminate volume connection completed successfully. Sep 01 00:17:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-1872752f-c20d-4375-a605-9884c3d200fd req-4c2e34de-4c88-4f1c-b276-eade0de0db04 tempest-TaggedAttachmentsTest-1115928451 None] Deleting attachment 4193362c-97ab-40a3-80e0-157528212bdd. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:17:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-99b751af-31ae-4280-85b7-88bf713af1ee tempest-BackendsCapabilitiesAdminTestsJSON-1580463249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3857078552246, 'free_capacity_gb': 1774.3857078552246, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87803) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 00:17:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5090068d-6487-4e9e-9b4a-c13ec07e7d8d tempest-BackendsCapabilitiesAdminTestsJSON-1580463249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3857078552246, 'free_capacity_gb': 1774.3857078552246, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87803) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Flow 'volume_create_manager' (562f7e4c-50ec-4281-add8-15caf6584b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293fa09-d390-4ad0-b3d3-056fb7c2127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293fa09-d390-4ad0-b3d3-056fb7c2127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1079003390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23904589-af86-41bf-a926-1cca816d85e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf719876db4d4daedc12a7ab343d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:29Z,use_quota=True,user_id='cc7d9ed5604944caa95b29c7697627de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4beff4-5c3d-4690-a9e4-c884870b4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4beff4-5c3d-4690-a9e4-c884870b4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eff0f3-cd3e-4694-ae41-05849d7e9ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16eff0f3-cd3e-4694-ae41-05849d7e9ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23904589-af86-41bf-a926-1cca816d85e3', 'volume_name': 'volume-23904589-af86-41bf-a926-1cca816d85e3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74f6dbc-ef3d-4b97-99f7-d1cdd864d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74f6dbc-ef3d-4b97-99f7-d1cdd864d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a46443a-dfce-41cb-bd75-ec30b4fc264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Volume 23904589-af86-41bf-a926-1cca816d85e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23904589-af86-41bf-a926-1cca816d85e3', 'volume_size': 1} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1079003390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23904589-af86-41bf-a926-1cca816d85e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbf719876db4d4daedc12a7ab343d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:29Z,use_quota=True,user_id='cc7d9ed5604944caa95b29c7697627de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:17:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Creating volume 23904589-af86-41bf-a926-1cca816d85e3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:17:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:29 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 1073741824 Sep 01 00:17:29 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:29 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 1073741824" returned: 0 in 0.929s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:30 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 Sep 01 00:17:30 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:30 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3" returned: 0 in 0.529s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a46443a-dfce-41cb-bd75-ec30b4fc264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23904589-af86-41bf-a926-1cca816d85e3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2472a4e-abb0-473f-8400-8d9bf8b5970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Volume volume-23904589-af86-41bf-a926-1cca816d85e3 (23904589-af86-41bf-a926-1cca816d85e3): created successfully Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2472a4e-abb0-473f-8400-8d9bf8b5970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Flow 'volume_create_manager' (562f7e4c-50ec-4281-add8-15caf6584b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-18306f14-5b08-4478-89f4-fef6fee166c6 tempest-VolumesAdminNegativeTest-1728177864 None] Created volume successfully. Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Acquiring lock "cinder-23904589-af86-41bf-a926-1cca816d85e3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "cinder-23904589-af86-41bf-a926-1cca816d85e3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Acquiring lock "cinder-quobyte-23904589-af86-41bf-a926-1cca816d85e3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "cinder-quobyte-23904589-af86-41bf-a926-1cca816d85e3" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aebea8-a7b9-4c55-b06f-1b0ddd9b0a03]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:17:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:32 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 Sep 01 00:17:32 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:33 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3" returned: 0 in 0.742s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:33 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3 Sep 01 00:17:33 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:33 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-23904589-af86-41bf-a926-1cca816d85e3" returned: 0 in 0.496s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "cinder-quobyte-23904589-af86-41bf-a926-1cca816d85e3" released by "delete_volume" :: held 1.345s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Created reservations ['7b46aa09-b6ca-4885-a81d-ab033840e8a4', 'f6e2a642-45b4-4c4a-911c-981c5b049ee3', 'df379add-3f71-4f79-b693-652e9bf00d00', '98bcfb12-2f3b-4f16-b416-7b100f0d0b78'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:34 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:17:34 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:34 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.825s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:34 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:17:34 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Deleted volume successfully. Sep 01 00:17:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cd9f7b6d-d30c-4795-897d-813e14b293de tempest-VolumesAdminNegativeTest-1728177864 None] Lock "cinder-23904589-af86-41bf-a926-1cca816d85e3-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Flow 'volume_create_manager' (2e1eeae0-b72e-42c9-9816-925c5511373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36795499-16b5-49f2-932c-1ce710813f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36795499-16b5-49f2-932c-1ce710813f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-18700331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c976b92b-b311-44b7-8ae5-d6a9af9a87d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efb1cc4e2b94f388d8145d3e5c5d1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:37Z,use_quota=True,user_id='e3fdc71c878c45f5b7626d180f06d333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30b71f1-20e9-420c-aecb-066f1a85eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30b71f1-20e9-420c-aecb-066f1a85eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd0805-6b5f-40c1-9661-7bae2951a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd0805-6b5f-40c1-9661-7bae2951a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c976b92b-b311-44b7-8ae5-d6a9af9a87d4', 'volume_name': 'volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005dd0a5-deef-4735-8e08-a9000484c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005dd0a5-deef-4735-8e08-a9000484c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56600652-50b4-4a82-b0bf-6b9d98caf442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Volume c976b92b-b311-44b7-8ae5-d6a9af9a87d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4', 'volume_size': 1} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-18700331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c976b92b-b311-44b7-8ae5-d6a9af9a87d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3efb1cc4e2b94f388d8145d3e5c5d1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:37Z,use_quota=True,user_id='e3fdc71c878c45f5b7626d180f06d333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Creating volume c976b92b-b311-44b7-8ae5-d6a9af9a87d4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:17:37 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:17:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:37 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 1073741824 Sep 01 00:17:37 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:38 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 1073741824" returned: 0 in 1.020s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:38 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 Sep 01 00:17:38 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:38 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" returned: 0 in 0.519s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56600652-50b4-4a82-b0bf-6b9d98caf442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4667af45-b2a6-420d-abba-182245c34abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Volume volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 (c976b92b-b311-44b7-8ae5-d6a9af9a87d4): created successfully Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4667af45-b2a6-420d-abba-182245c34abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Flow 'volume_create_manager' (2e1eeae0-b72e-42c9-9816-925c5511373f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-61d00572-b043-4adf-a14d-15bf5770aad7 tempest-ServerRescueNegativeTestJSON-54419178 None] Created volume successfully. Sep 01 00:17:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4fe80ca3-5d23-421e-b7e6-c3e2a2b43686 tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-1175950848: creating Sep 01 00:17:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4fe80ca3-5d23-421e-b7e6-c3e2a2b43686 tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-1175950848: created successfully Sep 01 00:17:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4fe80ca3-5d23-421e-b7e6-c3e2a2b43686 tempest-GroupSnapshotsTest-1942090241 None] Create group completed successfully. Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "cinder-afb023d1-9d28-4fb3-9711-666395494a16-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "cinder-afb023d1-9d28-4fb3-9711-666395494a16-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "cinder-quobyte-afb023d1-9d28-4fb3-9711-666395494a16" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "cinder-quobyte-afb023d1-9d28-4fb3-9711-666395494a16" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[260598cb-3fe0-41e0-aedd-2b835b83346d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:17:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (1da68612-a80a-4148-9d15-64d3a6b2cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eff5c8b-896a-4f06-ae93-aa226c9fbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:42 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 Sep 01 00:17:42 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eff5c8b-896a-4f06-ae93-aa226c9fbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760034818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c4ee9f4-44ff-43b5-931b-109bbbb522f8,host='devstack@QuobyteHD#QuobyteHD',id=e2011676-4a6b-4ea1-b57c-e99abd5cc7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:42Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91a0528e-a013-4f35-b9af-98acd8b47f1e),volume_type_id=91a0528e-a013-4f35-b9af-98acd8b47f1e)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cde2b0-47d3-4187-9169-91fb6b0a77d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cde2b0-47d3-4187-9169-91fb6b0a77d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28763f64-34c0-4535-b1f4-da54167ecb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28763f64-34c0-4535-b1f4-da54167ecb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2011676-4a6b-4ea1-b57c-e99abd5cc7fe', 'volume_name': 'volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8084273e-4849-4ddb-8151-29bf503e648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8084273e-4849-4ddb-8151-29bf503e648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d786f1-5025-4418-acc8-16c9b9e94f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Volume e2011676-4a6b-4ea1-b57c-e99abd5cc7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe', 'volume_size': 1} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4c4ee9f4-44ff-43b5-931b-109bbbb522f8,created_at=2026-08-31T22:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-760034818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4c4ee9f4-44ff-43b5-931b-109bbbb522f8,host='devstack@QuobyteHD#QuobyteHD',id=e2011676-4a6b-4ea1-b57c-e99abd5cc7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:17:42Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91a0528e-a013-4f35-b9af-98acd8b47f1e),volume_type_id=91a0528e-a013-4f35-b9af-98acd8b47f1e)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Creating volume e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:17:42 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:42 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe 1073741824 Sep 01 00:17:42 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:42 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16" returned: 0 in 0.520s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:42 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16 Sep 01 00:17:42 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:42 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe 1073741824" returned: 0 in 0.728s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:43 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:17:43 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:43 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-afb023d1-9d28-4fb3-9711-666395494a16" returned: 0 in 0.617s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "cinder-quobyte-afb023d1-9d28-4fb3-9711-666395494a16" released by "delete_volume" :: held 1.237s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Created reservations ['19325bcc-8b5e-45cd-b1ff-5e227becfc56', 'ffcbdf22-7633-4d60-9c2b-9311ee275281', 'dc0448f8-9505-4e49-85ee-87e5f0b1e0b1', '3c97c81b-b28d-4914-b889-eeb97063dfe4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:43 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:43 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:17:43 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d786f1-5025-4418-acc8-16c9b9e94f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f5cdde-559c-4a3b-b8ce-3df6dc2252be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:17:43 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Volume volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe (e2011676-4a6b-4ea1-b57c-e99abd5cc7fe): created successfully Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f5cdde-559c-4a3b-b8ce-3df6dc2252be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (1da68612-a80a-4148-9d15-64d3a6b2cd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:17:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-27c58d00-d1d8-4f67-9a89-3208f38c0dcf tempest-GroupSnapshotsTest-1942090241 None] Created volume successfully. Sep 01 00:17:43 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.479s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:17:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Deleted volume successfully. Sep 01 00:17:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e048440c-ed3b-4a97-8f56-ec3989498a67 tempest-TaggedAttachmentsTest-1115928451 None] Lock "cinder-afb023d1-9d28-4fb3-9711-666395494a16-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] GroupSnapshot 794e4e45-4390-4045-bd31-2df99000a768: creating. Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Group snapshot 794e4e45-4390-4045-bd31-2df99000a768: creating. {{(pid=87803) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Creating offline snapshot cd1559e3-2e62-435a-8334-3733bcd6b2f2 of volume e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2568e0-408e-489e-ab4c-82aa8b0d16a6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:44 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:17:44 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:44 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.511s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:44 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 1G Sep 01 00:17:44 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:45 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 1G" returned: 0 in 0.710s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:45 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:17:45 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:46 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.542s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:46 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:17:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:46 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:17:46 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:46 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.425s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:46 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info Sep 01 00:17:46 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:47 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info" returned: 0 in 0.489s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:47 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:17:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:47 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info Sep 01 00:17:47 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:47 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.info" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fc4144a4-ce17-403c-9ec4-6f13e445d038 tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 794e4e45-4390-4045-bd31-2df99000a768: created successfully Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Creating volume ab7d4a86-1ebe-43f6-95d0-36a872b5f397 from snapshot cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] snapshot: cd1559e3-2e62-435a-8334-3733bcd6b2f2, volume: ab7d4a86-1ebe-43f6-95d0-36a872b5f397, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42bd1e-c941-4c8d-a10a-7fb4db09bf78]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:17:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:50 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:17:50 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:50 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.600s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:17:50 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd28f555-41ad-4c04-b9e8-fcce91f64f58]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:17:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:50 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:17:50 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:51 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.537s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:17:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:17:51 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:17:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:51 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 Sep 01 00:17:51 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:59 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" returned: 0 in 8.397s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:17:59 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Converted 1024.00 MB image at 121.93 MB/s Sep 01 00:17:59 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:17:59 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 Sep 01 00:17:59 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=31,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:17:59 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" returned: 0 in 0.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" released by "_copy_volume_from_snapshot" :: held 10.035s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" released by "_create_volume_from_snapshot" :: held 10.165s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:17:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.202s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:00 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f7229633-bd33-499d-8fe3-31224e1ffb5f tempest-GroupSnapshotsTest-1942090241 None] Create group from source-snapshot-794e4e45-4390-4045-bd31-2df99000a768 completed successfully. Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf16c0d0-b689-4e89-8aa1-5b997a6d7149]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:01 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 Sep 01 00:18:01 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:01 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" returned: 0 in 0.457s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:01 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397 Sep 01 00:18:01 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:02 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" returned: 0 in 0.312s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-ab7d4a86-1ebe-43f6-95d0-36a872b5f397" released by "delete_volume" :: held 0.851s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['af7ff365-d66f-4cf8-acf9-a8a700bb2c64'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:02 devstack cinder-volume[87803]: WARNING cinder.quota [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1614834988 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1614834988, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:02 devstack cinder-volume[87803]: WARNING cinder.quota [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1614834988 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1614834988, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['5a672bcb-3d30-4042-a343-47814b5d6199', 'bbb76ce3-dfda-4b46-ae02-9539fb288236', 'da3d3084-b9c9-420e-a576-cb1c9696b133', '2b81b839-1173-4d18-a99d-a6c8e5615ba1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:02 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:02 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:03 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:03 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8bb601e4-846b-44cf-8ab9-ed00b7f86bbe tempest-GroupSnapshotsTest-1942090241 None] Delete group completed successfully. Sep 01 00:18:04 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 794e4e45-4390-4045-bd31-2df99000a768: deleting Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 794e4e45-4390-4045-bd31-2df99000a768: deleting {{(pid=87803) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Deleting offline snapshot cd1559e3-2e62-435a-8334-3733bcd6b2f2 of volume e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] snapshot_file for this snap is: volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2143ce9-7c13-4f6f-8798-8a4b7f029a33]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:04 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:18:04 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Acquiring lock "cinder-c976b92b-b311-44b7-8ae5-d6a9af9a87d4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "cinder-c976b92b-b311-44b7-8ae5-d6a9af9a87d4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Acquiring lock "cinder-quobyte-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "cinder-quobyte-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc311bc-85df-4bcd-b540-33f165bbba4a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:05 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.858s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb998dc9-41ca-41d5-a831-c3eca927a084]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:05 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 Sep 01 00:18:05 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:05 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:18:05 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:05 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" returned: 0 in 0.700s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:05 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4 Sep 01 00:18:05 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:06 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.951s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:06 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" returned: 0 in 0.397s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:06 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "cinder-quobyte-c976b92b-b311-44b7-8ae5-d6a9af9a87d4" released by "delete_volume" :: held 1.207s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:06 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Created reservations ['5a15b485-184a-42cc-95e6-2bd4cf04c4b9', '69fc5e94-b4fa-4f59-a648-f5a877749cf2', 'e176dc28-2bdb-4181-8f10-5458e29fb6b0', '1a60a0e9-783d-4152-97e1-61c545ca5699'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:06 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:06 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:06 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.568s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:06 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2 Sep 01 00:18:06 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:06 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.510s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:06 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Deleted volume successfully. Sep 01 00:18:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8f55b89e-0dc1-4cf5-a137-2a8e476d623a tempest-ServerRescueNegativeTestJSON-54419178 None] Lock "cinder-c976b92b-b311-44b7-8ae5-d6a9af9a87d4-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:07 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe.cd1559e3-2e62-435a-8334-3733bcd6b2f2" returned: 0 in 0.355s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cd1559e3-2e62-435a-8334-3733bcd6b2f2" released by "_delete_snapshot" :: held 2.899s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" released by "delete_snapshot" :: held 2.948s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:07 devstack cinder-volume[87803]: WARNING cinder.quota [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1614834988 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1614834988, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:07 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['13ccb24d-6b20-4895-abf0-b2336f93463f', '7872feda-322a-4809-afea-1c4f817302db', '7e913174-1fd8-43a4-a860-770c108f6e8a', '930d8089-4590-4187-8be7-41391d50b191'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c24e0727-05e5-4514-abc2-abfb3e7b5cc3 tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 794e4e45-4390-4045-bd31-2df99000a768: deleted successfully Sep 01 00:18:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" acquired by "delete_volume" :: waited 0.050s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4eda4-2d93-4511-80aa-8be5ef639770]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:08 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:18:08 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.618s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:09 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:09 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe Sep 01 00:18:09 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:09 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" returned: 0 in 0.403s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-e2011676-4a6b-4ea1-b57c-e99abd5cc7fe" released by "delete_volume" :: held 1.233s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['d406dd6d-46bc-4963-a988-7a7436df986e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:09 devstack cinder-volume[87803]: WARNING cinder.db.api [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1614834988'] Sep 01 00:18:09 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['8801ef98-88d0-4f21-be60-239214734950', '0e2a6eb6-0e87-4dba-8bc6-90df10c64ad8', 'c535a4a1-b6cf-460d-8811-9e2e396d1238', '490c2b3b-8ee1-44c1-abf9-21e7b9efaf29'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:10 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:10 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:10 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.476s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:10 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a25638aa-3cad-4322-963a-290e1e2fb9c5 tempest-GroupSnapshotsTest-1942090241 None] Delete group completed successfully. Sep 01 00:18:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-de6412b8-b19e-43cb-8ce3-2aa4ba8f15dd tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-79717961: creating Sep 01 00:18:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-de6412b8-b19e-43cb-8ce3-2aa4ba8f15dd tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-79717961: created successfully Sep 01 00:18:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-de6412b8-b19e-43cb-8ce3-2aa4ba8f15dd tempest-GroupSnapshotsTest-1942090241 None] Create group completed successfully. Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (0c8dfa39-732a-40e7-ad9e-a17522d04b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613b232e-5144-4533-a106-f6161dc3c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613b232e-5144-4533-a106-f6161dc3c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282553995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,host='devstack@QuobyteHD#QuobyteHD',id=b150ee5b-cc84-45f6-b34e-2ae59b116111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:13Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3674ff00-ac1e-4965-adb8-cb12d99de365),volume_type_id=3674ff00-ac1e-4965-adb8-cb12d99de365)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:13 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422b149d-d3fa-489b-93ba-d4eb3d300cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:13 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422b149d-d3fa-489b-93ba-d4eb3d300cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013a6092-0a8f-44a7-8665-66033dac8e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013a6092-0a8f-44a7-8665-66033dac8e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b150ee5b-cc84-45f6-b34e-2ae59b116111', 'volume_name': 'volume-b150ee5b-cc84-45f6-b34e-2ae59b116111', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0936f8-cb80-40b5-aaee-4a6289cd2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0936f8-cb80-40b5-aaee-4a6289cd2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5686cd55-3071-4227-93b5-5ce74f67fefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:13 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Volume b150ee5b-cc84-45f6-b34e-2ae59b116111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b150ee5b-cc84-45f6-b34e-2ae59b116111', 'volume_size': 1} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,created_at=2026-08-31T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282553995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,host='devstack@QuobyteHD#QuobyteHD',id=b150ee5b-cc84-45f6-b34e-2ae59b116111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:13Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3674ff00-ac1e-4965-adb8-cb12d99de365),volume_type_id=3674ff00-ac1e-4965-adb8-cb12d99de365)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Creating volume b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:18:13 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:13 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 1073741824 Sep 01 00:18:13 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:13 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.285s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 8 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:18:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:18:14 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 1073741824" returned: 0 in 0.650s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:14 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 Sep 01 00:18:14 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:14 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5686cd55-3071-4227-93b5-5ce74f67fefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b150ee5b-cc84-45f6-b34e-2ae59b116111', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64478bb4-f444-4442-973a-12c111b75524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:14 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Volume volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 (b150ee5b-cc84-45f6-b34e-2ae59b116111): created successfully Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64478bb4-f444-4442-973a-12c111b75524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (0c8dfa39-732a-40e7-ad9e-a17522d04b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2a0cebf8-9603-4161-9506-5e8782e9b6b8 tempest-GroupSnapshotsTest-1942090241 None] Created volume successfully. Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (ec0b5cc6-a362-4ed0-84ee-73d5657076a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae600010-2d09-4590-9da8-e81bdf77824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae600010-2d09-4590-9da8-e81bdf77824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372473349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,host='devstack@QuobyteHD#QuobyteHD',id=4749d28e-615c-4849-b4d6-55016f0a6a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:17Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3674ff00-ac1e-4965-adb8-cb12d99de365),volume_type_id=3674ff00-ac1e-4965-adb8-cb12d99de365)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bf50cb-9555-49fa-9f0f-4cf141bc81ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bf50cb-9555-49fa-9f0f-4cf141bc81ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f60f11-815b-43c8-b7a7-bf365c086dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f60f11-815b-43c8-b7a7-bf365c086dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4749d28e-615c-4849-b4d6-55016f0a6a88', 'volume_name': 'volume-4749d28e-615c-4849-b4d6-55016f0a6a88', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939dadd-083a-4ca3-9ccd-d04b84d8bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939dadd-083a-4ca3-9ccd-d04b84d8bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712bf941-a2f5-4bff-8196-74cb6737f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:16 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Volume 4749d28e-615c-4849-b4d6-55016f0a6a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4749d28e-615c-4849-b4d6-55016f0a6a88', 'volume_size': 1} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,created_at=2026-08-31T22:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372473349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d620b2c0-0a41-4564-af25-5dab1f4a87ba,host='devstack@QuobyteHD#QuobyteHD',id=4749d28e-615c-4849-b4d6-55016f0a6a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:17Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3674ff00-ac1e-4965-adb8-cb12d99de365),volume_type_id=3674ff00-ac1e-4965-adb8-cb12d99de365)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Creating volume 4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:18:16 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:18:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:16 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 1073741824 Sep 01 00:18:16 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:17 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 1073741824" returned: 0 in 0.530s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:17 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 Sep 01 00:18:17 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:17 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712bf941-a2f5-4bff-8196-74cb6737f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4749d28e-615c-4849-b4d6-55016f0a6a88', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a68f73-99ea-4979-9805-5c6b25e1984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:17 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Volume volume-4749d28e-615c-4849-b4d6-55016f0a6a88 (4749d28e-615c-4849-b4d6-55016f0a6a88): created successfully Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a68f73-99ea-4979-9805-5c6b25e1984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (ec0b5cc6-a362-4ed0-84ee-73d5657076a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b10ce298-da47-4fa5-b550-87b112e47159 tempest-GroupSnapshotsTest-1942090241 None] Created volume successfully. Sep 01 00:18:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-92e5f0dc-ac45-4ada-8683-009f5dec0aa4 tempest-GroupSnapshotsTest-1942090241 None] Update group completed successfully. Sep 01 00:18:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b7538846-9f24-4d59-a84e-cc84972be2e7 tempest-GroupSnapshotsTest-1942090241 None] Update group completed successfully. Sep 01 00:18:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-be1823e8-b819-4de9-ba4d-55605e8fd4ed tempest-GroupSnapshotsTest-1942090241 None] Update group completed successfully. Sep 01 00:18:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4253bacc-31c6-4904-a148-a07e3a03c2f8 tempest-GroupSnapshotsTest-1942090241 None] Update group completed successfully. Sep 01 00:18:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] GroupSnapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: creating. Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Group snapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: creating. {{(pid=87803) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Creating offline snapshot 3f26c8d3-c687-4655-956b-dde3e057d645 of volume 4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ed9ab-fb7e-456f-9ff8-38b569eee58d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:23 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 Sep 01 00:18:23 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:23 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88" returned: 0 in 0.437s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:24 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 1G Sep 01 00:18:24 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:24 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 1G" returned: 0 in 0.596s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749d28e-615c-4849-b4d6-55016f0a6a88 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:24 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749d28e-615c-4849-b4d6-55016f0a6a88 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 Sep 01 00:18:24 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:24 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4749d28e-615c-4849-b4d6-55016f0a6a88 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645" returned: 0 in 0.430s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:24 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:25 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 Sep 01 00:18:25 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:25 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:25 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info Sep 01 00:18:25 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:25 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info" returned: 0 in 0.293s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:25 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:25 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info Sep 01 00:18:25 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:25 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.info" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Creating offline snapshot 9255d84e-4284-4923-a5c9-97ef675cf518 of volume b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d008e7-aa3a-4b20-b9e1-f8864db9c57a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:26 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 Sep 01 00:18:26 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:26 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111" returned: 0 in 0.402s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:26 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 1G Sep 01 00:18:26 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:26 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 1G" returned: 0 in 0.584s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:26 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 Sep 01 00:18:26 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:27 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:27 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:27 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 Sep 01 00:18:27 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:27 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518" returned: 0 in 0.308s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:27 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info Sep 01 00:18:27 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:28 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:28 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:28 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info Sep 01 00:18:28 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:28 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.info" returned: 0 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5b065706-d3fa-4bd3-b08c-f1039c6f617e tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: created successfully Sep 01 00:18:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: deleting Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: deleting {{(pid=87803) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-3f26c8d3-c687-4655-956b-dde3e057d645" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-3f26c8d3-c687-4655-956b-dde3e057d645" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Deleting offline snapshot 3f26c8d3-c687-4655-956b-dde3e057d645 of volume 4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] snapshot_file for this snap is: volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[de89e46b-9088-4625-8a35-fd798a44c027]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:29 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 Sep 01 00:18:29 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:29 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645" returned: 0 in 0.557s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4749d28e-615c-4849-b4d6-55016f0a6a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1dbf3-de76-4951-9e00-cad0d8d5313b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:29 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 Sep 01 00:18:29 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:30 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88" returned: 0 in 0.413s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:30 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 Sep 01 00:18:30 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:30 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645" returned: 0 in 0.401s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:30 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645 Sep 01 00:18:30 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:30 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88.3f26c8d3-c687-4655-956b-dde3e057d645" returned: 0 in 0.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-3f26c8d3-c687-4655-956b-dde3e057d645" released by "_delete_snapshot" :: held 1.850s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" released by "delete_snapshot" :: held 1.906s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-9255d84e-4284-4923-a5c9-97ef675cf518" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-9255d84e-4284-4923-a5c9-97ef675cf518" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Deleting offline snapshot 9255d84e-4284-4923-a5c9-97ef675cf518 of volume b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] snapshot_file for this snap is: volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[70afbfce-77b7-417c-98c8-347b84687a3f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:31 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 Sep 01 00:18:31 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:31 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b150ee5b-cc84-45f6-b34e-2ae59b116111(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d0e76-9c88-4beb-9de6-dd280cdfa7e3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:31 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 Sep 01 00:18:31 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:32 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111" returned: 0 in 0.431s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:32 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 Sep 01 00:18:32 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:32 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518" returned: 0 in 0.446s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:32 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518 Sep 01 00:18:32 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:32 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111.9255d84e-4284-4923-a5c9-97ef675cf518" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-9255d84e-4284-4923-a5c9-97ef675cf518" released by "_delete_snapshot" :: held 1.817s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" released by "delete_snapshot" :: held 1.846s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:33 devstack cinder-volume[87803]: WARNING cinder.quota [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-532600750 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-532600750, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:33 devstack cinder-volume[87803]: WARNING cinder.quota [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-532600750 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-532600750, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['20cf510e-35bf-41be-a64d-afa4436bb830', 'e602b139-9571-4772-8c4d-1eb4479395f1', 'ec9647b8-8749-4339-91b5-dd658993d5b7', '35dd80c4-4b77-4627-ad5e-eda18a5e6a6e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['f4ddeea0-f2fd-4295-9bbb-34b89d9287bf', '894f4572-ecce-4b1b-af85-b5a1c4bac994', '62557893-6bb5-4db0-9ae3-34a3a2b9c7c6', 'ae81f880-f06e-4e61-8fdb-3ede577cb3c4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8ca82e9c-fd37-4d2d-80d5-c8fb80c19b5b tempest-GroupSnapshotsTest-1942090241 None] group_snapshot 6e790c27-abcd-4fef-845f-4f96a66b0156: deleted successfully Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f61e6a6-5301-4364-8814-82547a5a1ba7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:34 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 Sep 01 00:18:34 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:34 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88" returned: 0 in 0.495s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:34 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88 Sep 01 00:18:34 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:35 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4749d28e-615c-4849-b4d6-55016f0a6a88" returned: 0 in 0.440s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-4749d28e-615c-4849-b4d6-55016f0a6a88" released by "delete_volume" :: held 1.032s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c961ad8a-59ce-40e9-a69a-334ce276f932]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:35 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 Sep 01 00:18:35 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:36 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111" returned: 0 in 0.692s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:36 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111 Sep 01 00:18:36 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:36 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b150ee5b-cc84-45f6-b34e-2ae59b116111" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b150ee5b-cc84-45f6-b34e-2ae59b116111" released by "delete_volume" :: held 1.124s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['28189659-ee24-4802-82a3-586efdb2cdaa'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:36 devstack cinder-volume[87803]: WARNING cinder.quota [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-532600750 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-532600750, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['9eee4c81-7c56-48ba-b19e-ff44e3da4078', '2b2ccc6e-9b97-4af2-b78f-a62cc3deafe1', 'af043a3e-0b5b-4343-9b22-abb6c442c44f', 'ff5e64ab-46cc-4022-aebe-276ffef12eeb'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:36 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['45cba83b-3e0c-4f1a-9afd-2c5194f87940', '416d4a9a-8adc-4e7d-a0e6-5d15665b45dc', 'a3e3007f-3713-42b0-977f-7d2df2379a7a', '96304f21-9c85-47d2-b114-b585b6afaa79'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:37 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:37 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:37 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.297s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:37 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-445b5211-409e-4645-9f07-10ff7410f47d tempest-GroupSnapshotsTest-1942090241 None] Delete group completed successfully. Sep 01 00:18:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-80330482-9f14-43e8-bc2e-cc1433670852 tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-977304727: creating Sep 01 00:18:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-80330482-9f14-43e8-bc2e-cc1433670852 tempest-GroupSnapshotsTest-1942090241 None] Group tempest-GroupSnapshotsTest-Group-977304727: created successfully Sep 01 00:18:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-80330482-9f14-43e8-bc2e-cc1433670852 tempest-GroupSnapshotsTest-1942090241 None] Create group completed successfully. Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (e5346ea9-98d0-4165-a028-1f5b7f0d5581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea996f70-842e-4d33-be73-705daf196254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea996f70-842e-4d33-be73-705daf196254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892280717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be90754f-d03a-4bfd-954b-204efb61305b,host='devstack@QuobyteHD#QuobyteHD',id=b50fd015-dd0e-4a9f-9f26-16b1c19c1907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:39Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760432a7-9084-4283-912c-0e8f2a660c72),volume_type_id=760432a7-9084-4283-912c-0e8f2a660c72)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40a93dc-9d6f-4acd-83ca-7aef3df5dbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a40a93dc-9d6f-4acd-83ca-7aef3df5dbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d502af-115b-416a-9181-eed7883c3023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d502af-115b-416a-9181-eed7883c3023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50fd015-dd0e-4a9f-9f26-16b1c19c1907', 'volume_name': 'volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fbcbfe-fd5c-4566-95e3-9f27fe5b81ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fbcbfe-fd5c-4566-95e3-9f27fe5b81ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaf8e58-f18b-4f0a-99a7-9c9249544170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Volume b50fd015-dd0e-4a9f-9f26-16b1c19c1907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907', 'volume_size': 1} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be90754f-d03a-4bfd-954b-204efb61305b,created_at=2026-08-31T22:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892280717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be90754f-d03a-4bfd-954b-204efb61305b,host='devstack@QuobyteHD#QuobyteHD',id=b50fd015-dd0e-4a9f-9f26-16b1c19c1907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561d1382dcd84acdae49619d8d38c4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:18:39Z,use_quota=True,user_id='2bc144d536cd4d8aba2fa4b694484162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760432a7-9084-4283-912c-0e8f2a660c72),volume_type_id=760432a7-9084-4283-912c-0e8f2a660c72)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Creating volume b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:18:39 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:18:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:39 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 1073741824 Sep 01 00:18:39 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:40 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 1073741824" returned: 0 in 0.655s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:40 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 Sep 01 00:18:40 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:40 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" returned: 0 in 0.516s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaf8e58-f18b-4f0a-99a7-9c9249544170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1a6c78-7d4e-4a17-976a-fa8a4b3e0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:18:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Volume volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 (b50fd015-dd0e-4a9f-9f26-16b1c19c1907): created successfully Sep 01 00:18:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1a6c78-7d4e-4a17-976a-fa8a4b3e0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:18:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Flow 'volume_create_manager' (e5346ea9-98d0-4165-a028-1f5b7f0d5581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:18:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4c2a3394-201b-49b4-9f9e-9ba25306508f tempest-GroupSnapshotsTest-1942090241 None] Created volume successfully. Sep 01 00:18:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] GroupSnapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: creating. Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Group snapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: creating. {{(pid=87803) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Creating offline snapshot cff0792d-3a77-4f7a-a806-a660fbb25145 of volume b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4841252d-3f35-4d26-ad8b-689a6f2cb901]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:43 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 Sep 01 00:18:43 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:43 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" returned: 0 in 0.674s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:43 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 1G Sep 01 00:18:43 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:44 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 1G" returned: 0 in 0.738s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:44 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 Sep 01 00:18:44 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:44 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145" returned: 0 in 0.322s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:44 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:44 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 Sep 01 00:18:44 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:44 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145" returned: 0 in 0.229s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:45 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info Sep 01 00:18:45 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:45 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info" returned: 0 in 0.424s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:45 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:18:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:45 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info Sep 01 00:18:45 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:45 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.info" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bc1cc509-5088-421d-99f0-6783c4d601c3 tempest-GroupSnapshotsTest-1942090241 None] group_snapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: created successfully Sep 01 00:18:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] group_snapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: deleting Sep 01 00:18:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] group_snapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: deleting {{(pid=87803) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 00:18:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-cff0792d-3a77-4f7a-a806-a660fbb25145" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cff0792d-3a77-4f7a-a806-a660fbb25145" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Deleting offline snapshot cff0792d-3a77-4f7a-a806-a660fbb25145 of volume b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] snapshot_file for this snap is: volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a8260-ca8b-44ed-bde1-deb30666afb8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:47 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 Sep 01 00:18:47 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:48 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145" returned: 0 in 0.899s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6560cc63-66fb-4068-a574-415e7baa7dc7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:48 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 Sep 01 00:18:48 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:48 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" returned: 0 in 0.839s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:49 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 Sep 01 00:18:49 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:49 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145" returned: 0 in 1.046s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:50 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145 Sep 01 00:18:50 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:50 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907.cff0792d-3a77-4f7a-a806-a660fbb25145" returned: 0 in 0.430s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-cff0792d-3a77-4f7a-a806-a660fbb25145" released by "_delete_snapshot" :: held 3.438s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" released by "delete_snapshot" :: held 3.512s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:50 devstack cinder-volume[87803]: WARNING cinder.quota [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1115759520 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1115759520, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:50 devstack cinder-volume[87803]: WARNING cinder.quota [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1115759520 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1115759520, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:50 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['c4a8e22c-0178-4e6e-8dcb-d7cdf99894e9', 'e53effb2-8a1a-43ea-a43b-ecc878e92f45', 'b8368ebf-97e1-4c2c-9200-86f816c2f6ff', '41957bc2-91d4-44a1-ac3e-9d9eb995750a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-62efed52-c40c-4142-be4e-ed889be9f2ff tempest-GroupSnapshotsTest-1942090241 None] group_snapshot a6dd5ca6-9a5d-493d-b6d6-4c4fc49f8679: deleted successfully Sep 01 00:18:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:18:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:18:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3887b-912c-4cff-b2b3-d1d5b2b34700]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:18:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:52 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 Sep 01 00:18:52 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:53 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" returned: 0 in 1.001s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:53 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907 Sep 01 00:18:53 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:53 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Lock "cinder-quobyte-b50fd015-dd0e-4a9f-9f26-16b1c19c1907" released by "delete_volume" :: held 1.514s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:18:53 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['09fa18ff-68ef-4e79-82ab-a3a151cb5f53'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:54 devstack cinder-volume[87803]: WARNING cinder.quota [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1115759520 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1115759520, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Created reservations ['b78aa6b7-017b-4e34-a385-41f4ccfb2132', '88533df2-c30f-478f-8924-5dd58034bfe7', '40b35879-65bf-4abb-be5c-5c4b81c0af05', '37bb7c5d-c217-4ea8-bbfa-3ca25be2a965'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:18:54 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:18:54 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:18:54 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.393s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:18:54 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:18:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f2149838-ffb4-4f34-b2d4-2c3627df1886 tempest-GroupSnapshotsTest-1942090241 None] Delete group completed successfully. Sep 01 00:19:03 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=106,cinder:UPDATE=105,cinder:INSERT=23 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:19:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ac01cf14-8b9f-43a7-8bee-6bdffe916ad9 tempest-GroupSnapshotsV319Test-55893275 None] Group tempest-GroupSnapshotsV319Test-Group-148285567: creating Sep 01 00:19:03 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=108,cinder:SELECT=102,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:19:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ac01cf14-8b9f-43a7-8bee-6bdffe916ad9 tempest-GroupSnapshotsV319Test-55893275 None] Group tempest-GroupSnapshotsV319Test-Group-148285567: created successfully Sep 01 00:19:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ac01cf14-8b9f-43a7-8bee-6bdffe916ad9 tempest-GroupSnapshotsV319Test-55893275 None] Create group completed successfully. Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Flow 'volume_create_manager' (b71270cf-4626-42f3-a04d-f8999b976412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae231de8-020f-4ff6-bbba-2fae526d94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae231de8-020f-4ff6-bbba-2fae526d94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368464287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc599702-3028-49d1-a772-e088c47fb1d7,host='devstack@QuobyteHD#QuobyteHD',id=c6b40b51-2ba5-46e3-987c-ec1c72937327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135b7c9f0dc04016855bc11ef35ce9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:05Z,use_quota=True,user_id='a54b83ea03bd4386b6af240603ee3ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fff3b8a2-0ca0-4b25-a705-8afa03e2ead4),volume_type_id=fff3b8a2-0ca0-4b25-a705-8afa03e2ead4)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f57384d-2e1f-4334-9b5a-536d40b9d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f57384d-2e1f-4334-9b5a-536d40b9d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7e8195-ef5f-44b0-be79-72e9299b845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7e8195-ef5f-44b0-be79-72e9299b845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b40b51-2ba5-46e3-987c-ec1c72937327', 'volume_name': 'volume-c6b40b51-2ba5-46e3-987c-ec1c72937327', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3dbd8d-fac9-4213-adf1-344c52da7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3dbd8d-fac9-4213-adf1-344c52da7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91853e39-d77e-43e8-84dc-b5689617a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Volume c6b40b51-2ba5-46e3-987c-ec1c72937327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b40b51-2ba5-46e3-987c-ec1c72937327', 'volume_size': 1} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc599702-3028-49d1-a772-e088c47fb1d7,created_at=2026-08-31T22:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368464287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc599702-3028-49d1-a772-e088c47fb1d7,host='devstack@QuobyteHD#QuobyteHD',id=c6b40b51-2ba5-46e3-987c-ec1c72937327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='135b7c9f0dc04016855bc11ef35ce9b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:05Z,use_quota=True,user_id='a54b83ea03bd4386b6af240603ee3ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fff3b8a2-0ca0-4b25-a705-8afa03e2ead4),volume_type_id=fff3b8a2-0ca0-4b25-a705-8afa03e2ead4)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Creating volume c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:04 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:04 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 1073741824 Sep 01 00:19:04 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:05 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 1073741824" returned: 0 in 0.443s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:05 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 Sep 01 00:19:05 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:05 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91853e39-d77e-43e8-84dc-b5689617a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b40b51-2ba5-46e3-987c-ec1c72937327', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7ee560-1935-4a5a-83ac-1b37465c4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Volume volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 (c6b40b51-2ba5-46e3-987c-ec1c72937327): created successfully Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7ee560-1935-4a5a-83ac-1b37465c4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Flow 'volume_create_manager' (b71270cf-4626-42f3-a04d-f8999b976412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-949fee7d-337c-422b-ad13-9ad0774e82e3 tempest-GroupSnapshotsV319Test-55893275 None] Created volume successfully. Sep 01 00:19:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] GroupSnapshot d727988f-186a-4697-8ee3-0d672018a8a9: creating. Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Group snapshot d727988f-186a-4697-8ee3-0d672018a8a9: creating. {{(pid=87803) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Creating offline snapshot 556bec20-29bf-48c0-8408-9c999d04c81a of volume c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7354c6af-70db-42cb-b513-683208b67083]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:06 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 Sep 01 00:19:06 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:06 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327" returned: 0 in 0.375s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:06 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a 1G Sep 01 00:19:06 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:07 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a 1G" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:07 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a Sep 01 00:19:07 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:07 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a" returned: 0 in 0.294s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:07 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:07 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a Sep 01 00:19:07 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:07 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:07 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info Sep 01 00:19:07 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:07 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info" returned: 0 in 0.235s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:07 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:19:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:07 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info Sep 01 00:19:07 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:08 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.info" returned: 0 in 0.228s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:08 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d9edb424-52ae-4314-86d2-b6a7c79e9584 tempest-GroupSnapshotsV319Test-55893275 None] group_snapshot d727988f-186a-4697-8ee3-0d672018a8a9: created successfully Sep 01 00:19:08 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] group_snapshot d727988f-186a-4697-8ee3-0d672018a8a9: deleting Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] group_snapshot d727988f-186a-4697-8ee3-0d672018a8a9: deleting {{(pid=87803) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "cinder-quobyte-556bec20-29bf-48c0-8408-9c999d04c81a" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-556bec20-29bf-48c0-8408-9c999d04c81a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Deleting offline snapshot 556bec20-29bf-48c0-8408-9c999d04c81a of volume c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] snapshot_file for this snap is: volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0f174e-c3e5-4935-9cb8-e1cb1760725a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:09 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a Sep 01 00:19:09 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:09 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b40b51-2ba5-46e3-987c-ec1c72937327(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7695c-eaf0-4f77-afd6-e9365e64ae51]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:09 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 Sep 01 00:19:09 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Flow 'volume_create_manager' (15806a6d-d5f4-48f7-83ae-7e3379c42ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526fe254-0a42-4ed0-a0ed-421abb6a90ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526fe254-0a42-4ed0-a0ed-421abb6a90ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-372553227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b84036-7a6f-4f63-abdf-b53ade247cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaf971c2eb4ee792f1d6694aaee364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:10Z,use_quota=True,user_id='67863e609c7f4da3ae9d4eacc10c7f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1683793f-f30f-4c74-aaa8-8c7b4106f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1683793f-f30f-4c74-aaa8-8c7b4106f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba73519f-526a-4c3d-bd3e-e56687092d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba73519f-526a-4c3d-bd3e-e56687092d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b84036-7a6f-4f63-abdf-b53ade247cac', 'volume_name': 'volume-c9b84036-7a6f-4f63-abdf-b53ade247cac', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f290a369-8331-46e6-9cbd-845e0e524634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f290a369-8331-46e6-9cbd-845e0e524634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec7ad7-a838-4cec-89d7-ac4f9b77aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Volume c9b84036-7a6f-4f63-abdf-b53ade247cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b84036-7a6f-4f63-abdf-b53ade247cac', 'volume_size': 1} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:09 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-372553227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b84036-7a6f-4f63-abdf-b53ade247cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaf971c2eb4ee792f1d6694aaee364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:10Z,use_quota=True,user_id='67863e609c7f4da3ae9d4eacc10c7f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Creating volume c9b84036-7a6f-4f63-abdf-b53ade247cac {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:09 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327" returned: 0 in 0.404s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:09 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac 1073741824 Sep 01 00:19:09 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:09 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a Sep 01 00:19:09 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:10 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a" returned: 0 in 0.444s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:10 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a Sep 01 00:19:10 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:10 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac 1073741824" returned: 0 in 0.583s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:10 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac Sep 01 00:19:10 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:10 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327.556bec20-29bf-48c0-8408-9c999d04c81a" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-556bec20-29bf-48c0-8408-9c999d04c81a" released by "_delete_snapshot" :: held 1.796s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" released by "delete_snapshot" :: held 1.846s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:10 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec7ad7-a838-4cec-89d7-ac4f9b77aa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b84036-7a6f-4f63-abdf-b53ade247cac', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8dac2b-b220-49a1-a2aa-a0310348d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:10 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Volume volume-c9b84036-7a6f-4f63-abdf-b53ade247cac (c9b84036-7a6f-4f63-abdf-b53ade247cac): created successfully Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8dac2b-b220-49a1-a2aa-a0310348d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Flow 'volume_create_manager' (15806a6d-d5f4-48f7-83ae-7e3379c42ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:10 devstack cinder-volume[87803]: WARNING cinder.quota [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-305558529 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-305558529, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:10 devstack cinder-volume[87803]: WARNING cinder.quota [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-305558529 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-305558529, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-28528dc5-687f-4621-ac8f-3d24e0ec8a5f tempest-AttachVolumeShelveTestJSON-1724105868 None] Created volume successfully. Sep 01 00:19:10 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] Created reservations ['c4c9c2d7-0956-441a-8558-519ff2101bbd', '4bad480a-6e7f-4957-bd13-451f0787dc8d', '23472d55-8d29-446e-af06-ae2b6f1c2736', 'ca272c94-8211-4312-a551-fa11bb883e9d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bf0d6d59-54c3-4ab2-b15c-39f65fb1e5a0 tempest-GroupSnapshotsV319Test-55893275 None] group_snapshot d727988f-186a-4697-8ee3-0d672018a8a9: deleted successfully Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68185cc9-fceb-4f97-96de-41076f796948]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:11 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 Sep 01 00:19:11 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:11 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327" returned: 0 in 0.402s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:11 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327 Sep 01 00:19:11 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:12 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c6b40b51-2ba5-46e3-987c-ec1c72937327" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Lock "cinder-quobyte-c6b40b51-2ba5-46e3-987c-ec1c72937327" released by "delete_volume" :: held 0.741s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Created reservations ['0372a492-1e5e-4bb0-a46e-2be3b201af3d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:12 devstack cinder-volume[87803]: WARNING cinder.quota [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-305558529 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-305558529, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Created reservations ['a4b4828b-9027-49eb-871e-417129749e79', '6c0ede9d-4a97-47c9-8234-553945e3da79', '522493c9-b057-442e-9f33-38407b1fbce5', '506375b4-40f2-4225-a2fb-4ec496389e67'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:12 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:19:12 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:12 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.314s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:12 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:19:12 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a8f73705-e13e-42fa-903f-a19029e36c8f tempest-GroupSnapshotsV319Test-55893275 None] Delete group completed successfully. Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:13 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:19:13 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:13 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 8 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:19:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Flow 'volume_create_manager' (2ef55c10-e2ed-4274-8a12-69767c439116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7150b0-6abc-44b0-a634-1900cb7780d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7150b0-6abc-44b0-a634-1900cb7780d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1287093904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26a52ee-222e-48dc-b731-c4b428fa9e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dab66b3bad4850b1fd38adca7614e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:15Z,use_quota=True,user_id='132c6964d488484c91ed1979e00a894b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e82fc7-292d-4e52-89af-38b1a5b0b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e82fc7-292d-4e52-89af-38b1a5b0b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69b0bcf-960c-4356-b5a3-a484892e233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69b0bcf-960c-4356-b5a3-a484892e233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26a52ee-222e-48dc-b731-c4b428fa9e43', 'volume_name': 'volume-d26a52ee-222e-48dc-b731-c4b428fa9e43', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b45da7-ad53-4c1c-ad85-4e3f97148a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b45da7-ad53-4c1c-ad85-4e3f97148a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e18894-5d90-4fab-b668-00c803ddfa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:15 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Volume d26a52ee-222e-48dc-b731-c4b428fa9e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26a52ee-222e-48dc-b731-c4b428fa9e43', 'volume_size': 1} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1287093904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26a52ee-222e-48dc-b731-c4b428fa9e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dab66b3bad4850b1fd38adca7614e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:15Z,use_quota=True,user_id='132c6964d488484c91ed1979e00a894b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Creating volume d26a52ee-222e-48dc-b731-c4b428fa9e43 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:15 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:15 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 1073741824 Sep 01 00:19:15 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:15 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 1073741824" returned: 0 in 0.567s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:15 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 Sep 01 00:19:15 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:16 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43" returned: 0 in 0.330s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e18894-5d90-4fab-b668-00c803ddfa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26a52ee-222e-48dc-b731-c4b428fa9e43', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d281f59-ec1d-4b66-b62e-7cece28e671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:16 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Volume volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 (d26a52ee-222e-48dc-b731-c4b428fa9e43): created successfully Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d281f59-ec1d-4b66-b62e-7cece28e671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Flow 'volume_create_manager' (2ef55c10-e2ed-4274-8a12-69767c439116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-db520b11-44dc-47e4-b56c-67a491a1d862 tempest-ServerActionsTestOtherA-721427442 None] Created volume successfully. Sep 01 00:19:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3eee9faa-9485-4c88-85c5-70819b7fe015 tempest-GroupsTest-1502462369 None] Group tempest-Group1-720133842: creating Sep 01 00:19:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3eee9faa-9485-4c88-85c5-70819b7fe015 tempest-GroupsTest-1502462369 None] Group tempest-Group1-720133842: created successfully Sep 01 00:19:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3eee9faa-9485-4c88-85c5-70819b7fe015 tempest-GroupsTest-1502462369 None] Create group completed successfully. Sep 01 00:19:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dfc55112-cb8b-4fbd-9943-958cbb81122c tempest-GroupsTest-1502462369 None] Group tempest-Group2-1535830810: creating Sep 01 00:19:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dfc55112-cb8b-4fbd-9943-958cbb81122c tempest-GroupsTest-1502462369 None] Group tempest-Group2-1535830810: created successfully Sep 01 00:19:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dfc55112-cb8b-4fbd-9943-958cbb81122c tempest-GroupsTest-1502462369 None] Create group completed successfully. Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (8e3989ec-7dbd-4f44-8990-6ec3c73faa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e140542f-7efa-4b87-9d24-c3d2eb9b4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e140542f-7efa-4b87-9d24-c3d2eb9b4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2055585591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13f21043-bdf0-4bd1-950c-0395f4a43b22,host='devstack@QuobyteHD#QuobyteHD',id=d5cb8b9d-3ebf-40ba-8957-901bc7413afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:22Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beb00d76-a1b7-4b1c-b101-358a27c2855b),volume_type_id=beb00d76-a1b7-4b1c-b101-358a27c2855b)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78df7786-cbe3-4904-8eb6-ee7e0a1a36eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78df7786-cbe3-4904-8eb6-ee7e0a1a36eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c455b56-e101-4850-88b1-9e74b42bd356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c455b56-e101-4850-88b1-9e74b42bd356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5cb8b9d-3ebf-40ba-8957-901bc7413afd', 'volume_name': 'volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f05dd-4702-4022-9403-629252fac0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f05dd-4702-4022-9403-629252fac0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f433420-41d7-4a1b-b49e-e1fe6f87ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Volume d5cb8b9d-3ebf-40ba-8957-901bc7413afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd', 'volume_size': 1} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13f21043-bdf0-4bd1-950c-0395f4a43b22,created_at=2026-08-31T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2055585591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13f21043-bdf0-4bd1-950c-0395f4a43b22,host='devstack@QuobyteHD#QuobyteHD',id=d5cb8b9d-3ebf-40ba-8957-901bc7413afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:22Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(beb00d76-a1b7-4b1c-b101-358a27c2855b),volume_type_id=beb00d76-a1b7-4b1c-b101-358a27c2855b)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Creating volume d5cb8b9d-3ebf-40ba-8957-901bc7413afd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:22 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:22 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd 1073741824 Sep 01 00:19:22 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:22 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd 1073741824" returned: 0 in 0.573s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:22 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd Sep 01 00:19:22 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-05971759-b044-4e6d-af8a-37d62d808a15 req-522c6269-6716-4c41-aa89-ea53ea28b535 tempest-AttachVolumeShelveTestJSON-1724105868 None] No connector for attachment 2f9315b4-ed1f-4ece-b91b-ae71483fd548; skipping storage backend terminate_connection call. {{(pid=87803) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-05971759-b044-4e6d-af8a-37d62d808a15 req-522c6269-6716-4c41-aa89-ea53ea28b535 tempest-AttachVolumeShelveTestJSON-1724105868 None] Deleting attachment 2f9315b4-ed1f-4ece-b91b-ae71483fd548. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:19:23 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" returned: 0 in 0.553s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f433420-41d7-4a1b-b49e-e1fe6f87ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1091c8d-79fc-489a-8505-71c36f9838c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:23 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Volume volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd (d5cb8b9d-3ebf-40ba-8957-901bc7413afd): created successfully Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1091c8d-79fc-489a-8505-71c36f9838c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (8e3989ec-7dbd-4f44-8990-6ec3c73faa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6b46b955-d2bb-449a-98bb-915eede9fdb7 tempest-GroupsTest-1502462369 None] Created volume successfully. Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (b15abec9-f7ba-4141-ba8f-d06b03e52e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165be92f-eda6-4a46-b858-f170ef808212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165be92f-eda6-4a46-b858-f170ef808212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341273206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456536fb-8467-4533-874f-b8ce105ce128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:24Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e919b84-8faa-44bf-a051-2dae9dd944bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e919b84-8faa-44bf-a051-2dae9dd944bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc91eab0-f575-4e7c-a61a-cac11dadd638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc91eab0-f575-4e7c-a61a-cac11dadd638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456536fb-8467-4533-874f-b8ce105ce128', 'volume_name': 'volume-456536fb-8467-4533-874f-b8ce105ce128', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeafdc9-515a-47e4-85ae-fe19b1a1af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeafdc9-515a-47e4-85ae-fe19b1a1af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb62d5-3e95-43c0-a3d0-e7bdd4f765a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Volume 456536fb-8467-4533-874f-b8ce105ce128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456536fb-8467-4533-874f-b8ce105ce128', 'volume_size': 1} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1341273206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456536fb-8467-4533-874f-b8ce105ce128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:24Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Creating volume 456536fb-8467-4533-874f-b8ce105ce128 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:24 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:24 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 1073741824 Sep 01 00:19:24 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:24 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 1073741824" returned: 0 in 0.707s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:25 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 Sep 01 00:19:25 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:25 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afb62d5-3e95-43c0-a3d0-e7bdd4f765a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456536fb-8467-4533-874f-b8ce105ce128', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f63ba6-7097-47ff-8292-505df873b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Volume volume-456536fb-8467-4533-874f-b8ce105ce128 (456536fb-8467-4533-874f-b8ce105ce128): created successfully Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f63ba6-7097-47ff-8292-505df873b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (b15abec9-f7ba-4141-ba8f-d06b03e52e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d612db13-1d18-4146-b866-cde12d813373 tempest-AttachVolumeTestJSON-2070579472 None] Created volume successfully. Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Acquiring lock "cinder-quobyte-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7443d595-1972-4401-99d2-0ec24c3186d5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:25 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd Sep 01 00:19:25 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:26 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" returned: 0 in 0.685s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:26 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd Sep 01 00:19:26 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:26 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" returned: 0 in 0.446s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-d5cb8b9d-3ebf-40ba-8957-901bc7413afd" released by "delete_volume" :: held 1.209s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Created reservations ['5b56cb94-e60c-4c47-beab-ec878b0217be'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:27 devstack cinder-volume[87803]: WARNING cinder.quota [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-119226027 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-119226027, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:27 devstack cinder-volume[87803]: WARNING cinder.quota [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-119226027 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-119226027, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Created reservations ['d42bf6ea-ac8f-46ea-a38b-7dce6dfe8b0d', '714fb548-d964-481d-8351-728ae37e0503', '12b09545-3609-4cf1-9cea-fa839071d25d', '359c8d0b-7719-4536-a81a-0d6ce16b31fe'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:27 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:19:27 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:27 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:19:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9d9a8a6b-5d4b-4d60-80f0-cf4dce535b94 tempest-GroupsTest-1502462369 None] Delete group completed successfully. Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-01a85826-64fb-4a31-b5bd-b3d51e010460 req-50646118-0ff3-4024-98a6-e860908e9d5b tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-01a85826-64fb-4a31-b5bd-b3d51e010460 req-50646118-0ff3-4024-98a6-e860908e9d5b tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-01a85826-64fb-4a31-b5bd-b3d51e010460 req-50646118-0ff3-4024-98a6-e860908e9d5b tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-01a85826-64fb-4a31-b5bd-b3d51e010460 req-50646118-0ff3-4024-98a6-e860908e9d5b tempest-AttachVolumeTestJSON-2070579472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-456536fb-8467-4533-874f-b8ce105ce128', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31217cd3-e107-495b-940f-e4288210804b', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:19:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-01a85826-64fb-4a31-b5bd-b3d51e010460 req-50646118-0ff3-4024-98a6-e860908e9d5b tempest-AttachVolumeTestJSON-2070579472 None] attachment_update completed successfully. Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Created reservations ['67832b58-ba5f-427b-8f7f-9cf611ded69f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:28 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:19:28 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:29 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.564s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:29 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:19:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-98b557c3-40d7-4660-a97b-dd2cd6e401d0 tempest-GroupsTest-1502462369 None] Delete group completed successfully. Sep 01 00:19:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-146ed2e5-b586-4360-9449-a6164a3fd302 tempest-GroupsTest-1502462369 None] Group tempest-GroupsTest-Group-1917815213: creating Sep 01 00:19:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-146ed2e5-b586-4360-9449-a6164a3fd302 tempest-GroupsTest-1502462369 None] Group tempest-GroupsTest-Group-1917815213: created successfully Sep 01 00:19:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-146ed2e5-b586-4360-9449-a6164a3fd302 tempest-GroupsTest-1502462369 None] Create group completed successfully. Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (697fb89a-5eec-4878-81ae-9aa0cba76514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12cc02d-e127-4d5c-8fa6-5c38ea1492ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12cc02d-e127-4d5c-8fa6-5c38ea1492ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-777567371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,host='devstack@QuobyteHD#QuobyteHD',id=0ef5cab1-7d2a-4402-b04f-3b907feacdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:33Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f16296e-34f1-47fb-b608-1dec40d5295d),volume_type_id=4f16296e-34f1-47fb-b608-1dec40d5295d)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0372026c-3c2d-4b1d-b6aa-e0bb8cf6c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0372026c-3c2d-4b1d-b6aa-e0bb8cf6c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78f1ff8-6c3b-4cf1-a0b5-1781c2eed110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78f1ff8-6c3b-4cf1-a0b5-1781c2eed110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef5cab1-7d2a-4402-b04f-3b907feacdfd', 'volume_name': 'volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba5ba5c-e0d1-451e-9130-e99ab7bf98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba5ba5c-e0d1-451e-9130-e99ab7bf98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a5fa3-0901-4b73-91ec-70061bc3f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Volume 0ef5cab1-7d2a-4402-b04f-3b907feacdfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd', 'volume_size': 1} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,created_at=2026-08-31T22:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-777567371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,host='devstack@QuobyteHD#QuobyteHD',id=0ef5cab1-7d2a-4402-b04f-3b907feacdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:33Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f16296e-34f1-47fb-b608-1dec40d5295d),volume_type_id=4f16296e-34f1-47fb-b608-1dec40d5295d)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Creating volume 0ef5cab1-7d2a-4402-b04f-3b907feacdfd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:33 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:33 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd 1073741824 Sep 01 00:19:33 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:33 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd 1073741824" returned: 0 in 0.587s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:33 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd Sep 01 00:19:33 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:34 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" returned: 0 in 0.777s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76a5fa3-0901-4b73-91ec-70061bc3f66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f2d3bf-9d99-493d-b4c6-5f0aba78eef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Volume volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd (0ef5cab1-7d2a-4402-b04f-3b907feacdfd): created successfully Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f2d3bf-9d99-493d-b4c6-5f0aba78eef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (697fb89a-5eec-4878-81ae-9aa0cba76514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:34 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8f11c0a3-7552-4ea3-9fc6-285f573a9010 tempest-GroupsTest-1502462369 None] Created volume successfully. Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (ad15b73b-49b2-4d4f-a604-1880e692c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadefa6d-22df-4d8f-8d13-a84bfcb6beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadefa6d-22df-4d8f-8d13-a84bfcb6beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-482525914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,host='devstack@QuobyteHD#QuobyteHD',id=c2434d73-0c72-4389-a351-f4b10eb694d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:37Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f16296e-34f1-47fb-b608-1dec40d5295d),volume_type_id=4f16296e-34f1-47fb-b608-1dec40d5295d)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500069e9-c9ad-43c2-bc01-ae1c81e7a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500069e9-c9ad-43c2-bc01-ae1c81e7a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e88c11c-a130-4de1-b375-45b272ac334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e88c11c-a130-4de1-b375-45b272ac334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2434d73-0c72-4389-a351-f4b10eb694d4', 'volume_name': 'volume-c2434d73-0c72-4389-a351-f4b10eb694d4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319b3fc0-472d-43b8-b3a3-93c4eebafc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319b3fc0-472d-43b8-b3a3-93c4eebafc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a3a73-5e04-45ab-a6e7-ab4e63c867f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Volume c2434d73-0c72-4389-a351-f4b10eb694d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2434d73-0c72-4389-a351-f4b10eb694d4', 'volume_size': 1} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,created_at=2026-08-31T22:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-482525914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aad67d15-e5c1-40e7-ba8d-e824cdbf0133,host='devstack@QuobyteHD#QuobyteHD',id=c2434d73-0c72-4389-a351-f4b10eb694d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5fa3bb7faa04826b5bb560f060a70d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:19:37Z,use_quota=True,user_id='b17755ae61e94f8692697979d63b9d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f16296e-34f1-47fb-b608-1dec40d5295d),volume_type_id=4f16296e-34f1-47fb-b608-1dec40d5295d)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Creating volume c2434d73-0c72-4389-a351-f4b10eb694d4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:19:37 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:19:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:37 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 1073741824 Sep 01 00:19:37 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:38 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 1073741824" returned: 0 in 0.911s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:38 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 Sep 01 00:19:38 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:39 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4" returned: 0 in 0.875s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a3a73-5e04-45ab-a6e7-ab4e63c867f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2434d73-0c72-4389-a351-f4b10eb694d4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc1fe50-d827-4256-ab77-c777cc333095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:19:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Volume volume-c2434d73-0c72-4389-a351-f4b10eb694d4 (c2434d73-0c72-4389-a351-f4b10eb694d4): created successfully Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc1fe50-d827-4256-ab77-c777cc333095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:19:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Flow 'volume_create_manager' (ad15b73b-49b2-4d4f-a604-1880e692c968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:19:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5cd22dd0-0da2-48ba-b7fa-02d0b76aa034 tempest-GroupsTest-1502462369 None] Created volume successfully. Sep 01 00:19:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-739ae959-dae4-47ea-ad81-94c5f331b1f0 tempest-GroupsTest-1502462369 None] Update group completed successfully. Sep 01 00:19:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ef18b042-c005-4b39-a555-657ef4aa66be tempest-GroupsTest-1502462369 None] Update group completed successfully. Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Acquiring lock "cinder-quobyte-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b9d58-e709-436f-b0a5-0784dc4ea01e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:44 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd Sep 01 00:19:44 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:44 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:44 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd Sep 01 00:19:44 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:44 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" returned: 0 in 0.237s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-0ef5cab1-7d2a-4402-b04f-3b907feacdfd" released by "delete_volume" :: held 0.718s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Acquiring lock "cinder-quobyte-c2434d73-0c72-4389-a351-f4b10eb694d4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-c2434d73-0c72-4389-a351-f4b10eb694d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a3a16c-fa1e-4fce-90fa-3dfeca3f3e7f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:19:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:45 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 Sep 01 00:19:45 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:45 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4" returned: 0 in 0.349s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:45 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4 Sep 01 00:19:45 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:45 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c2434d73-0c72-4389-a351-f4b10eb694d4" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "cinder-quobyte-c2434d73-0c72-4389-a351-f4b10eb694d4" released by "delete_volume" :: held 0.697s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Created reservations ['ad00257d-2aa9-47aa-868f-718dcdae650a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:45 devstack cinder-volume[87803]: WARNING cinder.quota [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1942264626 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1942264626, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:45 devstack cinder-volume[87803]: WARNING cinder.quota [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1942264626 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1942264626, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Created reservations ['830001d2-d482-41a3-b45d-f0b352739fb9', '1b05da8b-ea5f-4b5d-b6d5-805398967207', '6f1ecb39-3b03-46a0-b0ec-bd12597ae929', '492a1986-b116-4b17-bc8c-c21b09a8fda5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Created reservations ['ff3a42db-ddf6-4667-9dd0-04bcef1a2ab1', '96b4ca23-9a4a-4c91-992f-d6b68a2f4c6d', '6f445f0b-5d40-4a7d-ab54-7b0675df4483', '1d6a2e19-b065-47dc-adc6-804768f44d7a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:19:46 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:19:46 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:19:46 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.356s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:19:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:19:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c0b4f30b-4193-46be-924b-86fdbc617c7b tempest-GroupsTest-1502462369 None] Delete group completed successfully. Sep 01 00:19:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-186ed888-aabd-4864-ae74-09b89b7c18ae req-752760cc-eb60-499e-876a-d317dceecdcc tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-186ed888-aabd-4864-ae74-09b89b7c18ae req-752760cc-eb60-499e-876a-d317dceecdcc tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-186ed888-aabd-4864-ae74-09b89b7c18ae req-752760cc-eb60-499e-876a-d317dceecdcc tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-186ed888-aabd-4864-ae74-09b89b7c18ae req-752760cc-eb60-499e-876a-d317dceecdcc tempest-ServerActionsTestOtherA-721427442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-d26a52ee-222e-48dc-b731-c4b428fa9e43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5d10d21-c38c-45c3-b949-7a2f698e58af', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:19:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-186ed888-aabd-4864-ae74-09b89b7c18ae req-752760cc-eb60-499e-876a-d317dceecdcc tempest-ServerActionsTestOtherA-721427442 None] attachment_update completed successfully. Sep 01 00:19:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-c5f326af-b348-48e2-b3e5-629729ea8a95 tempest-ServerActionsTestOtherA-721427442 None] Terminate volume connection completed successfully. Sep 01 00:19:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-c5f326af-b348-48e2-b3e5-629729ea8a95 tempest-ServerActionsTestOtherA-721427442 None] Deleting attachment f5d10d21-c38c-45c3-b949-7a2f698e58af. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:19:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-02e479ab-5715-4737-a89e-2cd2627319a2 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:19:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-02e479ab-5715-4737-a89e-2cd2627319a2 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:19:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-02e479ab-5715-4737-a89e-2cd2627319a2 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:19:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-02e479ab-5715-4737-a89e-2cd2627319a2 tempest-ServerActionsTestOtherA-721427442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-d26a52ee-222e-48dc-b731-c4b428fa9e43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3aeb84d-88f2-4341-bb02-83baf7203803', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:19:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-a56a4ac3-6e61-452e-b952-c778373b3f1d req-02e479ab-5715-4737-a89e-2cd2627319a2 tempest-ServerActionsTestOtherA-721427442 None] attachment_update completed successfully. Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Flow 'volume_create_manager' (cb058bb8-12eb-46f8-a342-f911803936f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934ff5d9-0237-411b-b7f6-7e866b292bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934ff5d9-0237-411b-b7f6-7e866b292bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1800848482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea2181a-8929-4239-8c8d-62d0f7669c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46cc4a9a534258b2a91270c2e05eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:02Z,use_quota=True,user_id='55471031978c4cefb668d82bba6cd06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa7419-bbbb-453d-8d44-4727207af04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfa7419-bbbb-453d-8d44-4727207af04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5ee68-a0d8-4406-bc03-399e30ebe250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5ee68-a0d8-4406-bc03-399e30ebe250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea2181a-8929-4239-8c8d-62d0f7669c24', 'volume_name': 'volume-3ea2181a-8929-4239-8c8d-62d0f7669c24', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58e36a8-8608-47a6-a493-49132dc5cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58e36a8-8608-47a6-a493-49132dc5cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950df8a4-c764-4da6-ac00-dc7237b38a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:01 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Volume 3ea2181a-8929-4239-8c8d-62d0f7669c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea2181a-8929-4239-8c8d-62d0f7669c24', 'volume_size': 1} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1800848482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea2181a-8929-4239-8c8d-62d0f7669c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46cc4a9a534258b2a91270c2e05eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:02Z,use_quota=True,user_id='55471031978c4cefb668d82bba6cd06e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Creating volume 3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:01 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:01 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 1073741824 Sep 01 00:20:01 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-e1a45d06-ae30-4225-86f2-01b99fe08ddf req-37bc5f4a-60fe-4592-9c89-db274058569f tempest-AttachVolumeTestJSON-2070579472 None] Terminate volume connection completed successfully. Sep 01 00:20:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-e1a45d06-ae30-4225-86f2-01b99fe08ddf req-37bc5f4a-60fe-4592-9c89-db274058569f tempest-AttachVolumeTestJSON-2070579472 None] Deleting attachment 31217cd3-e107-495b-940f-e4288210804b. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:20:02 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 1073741824" returned: 0 in 0.672s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:02 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 Sep 01 00:20:02 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:02 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24" returned: 0 in 0.348s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950df8a4-c764-4da6-ac00-dc7237b38a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea2181a-8929-4239-8c8d-62d0f7669c24', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876a01c-e609-4a02-8f11-1fa604211434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:02 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Volume volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 (3ea2181a-8929-4239-8c8d-62d0f7669c24): created successfully Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876a01c-e609-4a02-8f11-1fa604211434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Flow 'volume_create_manager' (cb058bb8-12eb-46f8-a342-f911803936f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3317e68d-4344-48b6-9403-7b9450eb433a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Created volume successfully. Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=92,cinder:SELECT=90,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=101,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Creating offline snapshot 0726d4c3-1b87-4447-b235-2e124903e74b of volume 3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d28ae5-8663-4922-a07d-fe205c9ebde0]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:04 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 Sep 01 00:20:04 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:04 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24" returned: 0 in 0.647s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:04 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b 1G Sep 01 00:20:04 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:05 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b 1G" returned: 0 in 0.678s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:05 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b Sep 01 00:20:05 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:05 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b" returned: 0 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:05 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b is being set with open permissions: ugo+rw Sep 01 00:20:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:05 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b Sep 01 00:20:05 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:06 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b" returned: 0 in 0.687s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:06 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info Sep 01 00:20:06 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:06 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info" returned: 0 in 0.329s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:06 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info is being set with open permissions: ugo+rw Sep 01 00:20:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:06 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info Sep 01 00:20:06 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:07 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.info" returned: 0 in 0.373s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.210s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ba612401-329f-4ef9-b5f0-52f979162b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Create snapshot completed successfully Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "cinder-0726d4c3-1b87-4447-b235-2e124903e74b-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-0726d4c3-1b87-4447-b235-2e124903e74b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "cinder-quobyte-0726d4c3-1b87-4447-b235-2e124903e74b" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-0726d4c3-1b87-4447-b235-2e124903e74b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Deleting offline snapshot 0726d4c3-1b87-4447-b235-2e124903e74b of volume 3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] snapshot_file for this snap is: volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd68e52-dddf-4aaa-9a7b-820ce0b80b76]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Acquiring lock "cinder-c9b84036-7a6f-4f63-abdf-b53ade247cac-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "cinder-c9b84036-7a6f-4f63-abdf-b53ade247cac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:09 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b Sep 01 00:20:09 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Acquiring lock "cinder-quobyte-c9b84036-7a6f-4f63-abdf-b53ade247cac" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "cinder-quobyte-c9b84036-7a6f-4f63-abdf-b53ade247cac" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddf2fa6-2d9f-490b-aa85-3e6ea5a631c2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:10 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac Sep 01 00:20:10 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:10 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b" returned: 0 in 0.544s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ea2181a-8929-4239-8c8d-62d0f7669c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c09fc-98b6-4ecb-8d9d-e5968b0cd7fe]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:10 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 Sep 01 00:20:10 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:10 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac" returned: 0 in 0.788s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:10 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac Sep 01 00:20:10 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:10 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24" returned: 0 in 0.622s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:10 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b Sep 01 00:20:10 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:11 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c9b84036-7a6f-4f63-abdf-b53ade247cac" returned: 0 in 0.420s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "cinder-quobyte-c9b84036-7a6f-4f63-abdf-b53ade247cac" released by "delete_volume" :: held 1.272s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Created reservations ['ff6876fa-31e4-435e-8024-84a03fc94572', '2b910112-b360-457a-9896-70c92f4894fb', '986b2f3a-69da-43aa-b93b-4de18b40a92b', '4aec131e-7fbd-41c6-859b-a62ec419327b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:11 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:11 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:11 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b" returned: 0 in 0.550s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:11 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b Sep 01 00:20:11 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:11 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Deleted volume successfully. Sep 01 00:20:11 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-954d943e-54f6-4cf5-a7b0-9be37ec2192d tempest-AttachVolumeShelveTestJSON-1724105868 None] Lock "cinder-c9b84036-7a6f-4f63-abdf-b53ade247cac-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24.0726d4c3-1b87-4447-b235-2e124903e74b" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-0726d4c3-1b87-4447-b235-2e124903e74b" released by "_delete_snapshot" :: held 2.157s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" released by "delete_snapshot" :: held 2.207s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:11 devstack cinder-volume[87803]: WARNING cinder.quota [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Created reservations ['6f33188f-be6b-42ce-92e4-707bab91e341', '02fba7d0-000b-4305-8227-43c6adac144c', 'c6be9ac6-4ef9-4fa7-93c5-72fd72a8da66', '113c2f98-9b27-4432-9a20-6a0f08748a83'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Delete snapshot completed successfully. Sep 01 00:20:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6c7bb161-630e-4d96-9744-7544d34b2b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-0726d4c3-1b87-4447-b235-2e124903e74b-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "cinder-3ea2181a-8929-4239-8c8d-62d0f7669c24-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-3ea2181a-8929-4239-8c8d-62d0f7669c24-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e556e7a-acff-4d90-bcff-65c734eea6ce]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:13 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 Sep 01 00:20:13 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:13 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24" returned: 0 in 0.430s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:13 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24 Sep 01 00:20:13 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:13 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:13 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:13 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3ea2181a-8929-4239-8c8d-62d0f7669c24" returned: 0 in 0.403s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-quobyte-3ea2181a-8929-4239-8c8d-62d0f7669c24" released by "delete_volume" :: held 0.924s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:13 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 8 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:20:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Created reservations ['b40afc3f-38a5-4147-b7c5-44b6de709075', 'fc0cdfc3-c4c4-4c91-887a-a018aecbb728', '871c93b0-4916-49e7-8c01-bf1782f43c5c', 'ef80918b-dd97-41d8-a6ee-73a32af107eb'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:14 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:14 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:14 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.394s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Deleted volume successfully. Sep 01 00:20:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fd9c8a8f-9d77-4010-8b44-5fb9e34b7a2a tempest-VolumeSnapshotQuotasNegativeTestJSON-743499740 None] Lock "cinder-3ea2181a-8929-4239-8c8d-62d0f7669c24-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Flow 'volume_create_manager' (310495de-fbca-4f45-a740-555c43f07272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274f364c-23c7-466d-b788-52fbfdbc67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274f364c-23c7-466d-b788-52fbfdbc67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-722160067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bcd25c-6dbc-4634-8639-14b321ed48e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f203d32fb164919ade606c268dd4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:21Z,use_quota=True,user_id='6fcecb81adb74778935f4dbac72216e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e524c0d-5aaf-41f1-a11a-8e17cbb73a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e524c0d-5aaf-41f1-a11a-8e17cbb73a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f47dcd9-3d48-49bb-982f-d69a9772a6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f47dcd9-3d48-49bb-982f-d69a9772a6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bcd25c-6dbc-4634-8639-14b321ed48e3', 'volume_name': 'volume-75bcd25c-6dbc-4634-8639-14b321ed48e3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131ed516-5f34-41a7-9eb1-1b0c71b308d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131ed516-5f34-41a7-9eb1-1b0c71b308d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d06df0-4d03-4994-aa8c-91a688331cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Volume 75bcd25c-6dbc-4634-8639-14b321ed48e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bcd25c-6dbc-4634-8639-14b321ed48e3', 'volume_size': 1} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-722160067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bcd25c-6dbc-4634-8639-14b321ed48e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f203d32fb164919ade606c268dd4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:21Z,use_quota=True,user_id='6fcecb81adb74778935f4dbac72216e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Creating volume 75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:21 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:21 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 1073741824 Sep 01 00:20:21 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:22 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 1073741824" returned: 0 in 0.716s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:22 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 Sep 01 00:20:22 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:22 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3" returned: 0 in 0.341s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d06df0-4d03-4994-aa8c-91a688331cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bcd25c-6dbc-4634-8639-14b321ed48e3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c62b27e-3d72-45fb-93ba-dbf34d20d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Volume volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 (75bcd25c-6dbc-4634-8639-14b321ed48e3): created successfully Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c62b27e-3d72-45fb-93ba-dbf34d20d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Flow 'volume_create_manager' (310495de-fbca-4f45-a740-555c43f07272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-545a2f10-982a-4d69-8d74-82c419aa2872 req-5894d9a7-974a-463e-9354-977918f88151 tempest-VolumesSnapshotsTestJSON-34530977 None] Created volume successfully. Sep 01 00:20:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Creating offline snapshot 6a7d785e-a927-4655-85b6-c094d40616fe of volume 75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:20:23 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[175726af-c1ab-46e9-9d13-829e810f54cc]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:23 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 Sep 01 00:20:23 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:24 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3" returned: 0 in 0.438s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:24 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe 1G Sep 01 00:20:24 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:24 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe 1G" returned: 0 in 0.468s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:24 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe Sep 01 00:20:24 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-64c8fdf6-18fe-4437-a4db-0d9b06b3e861 req-a0d7e82b-040a-46cd-a163-95d9a5035f05 tempest-ServerActionsTestOtherA-721427442 None] Terminate volume connection completed successfully. Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-64c8fdf6-18fe-4437-a4db-0d9b06b3e861 req-a0d7e82b-040a-46cd-a163-95d9a5035f05 tempest-ServerActionsTestOtherA-721427442 None] Deleting attachment d3aeb84d-88f2-4341-bb02-83baf7203803. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:20:24 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:24 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe is being set with open permissions: ugo+rw Sep 01 00:20:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:24 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe Sep 01 00:20:24 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:25 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:25 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info Sep 01 00:20:25 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:25 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info" returned: 0 in 0.258s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:25 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info is being set with open permissions: ugo+rw Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:25 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info Sep 01 00:20:25 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:25 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.info" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-ce491681-918d-4dd1-a36b-9b9244a90d7f req-f240e1d9-ae4f-478f-8a33-62f94b24cc41 tempest-VolumesSnapshotsTestJSON-34530977 None] Create snapshot completed successfully Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "cinder-6a7d785e-a927-4655-85b6-c094d40616fe-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-6a7d785e-a927-4655-85b6-c094d40616fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "cinder-quobyte-6a7d785e-a927-4655-85b6-c094d40616fe" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-6a7d785e-a927-4655-85b6-c094d40616fe" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Deleting offline snapshot 6a7d785e-a927-4655-85b6-c094d40616fe of volume 75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] snapshot_file for this snap is: volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Flow 'volume_create_manager' (c76ae30b-f669-405b-a6c5-8d6b470be6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2601a9c-3bcb-45d3-9fdd-b3aa9ca56857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[089383f0-4480-4abc-bb9c-56ba8f3459ff]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2601a9c-3bcb-45d3-9fdd-b3aa9ca56857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2005635702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3bd9b3-e34f-4d8a-92d5-06047e2268c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13eef2afc9e4606819cef8ecf13de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:26Z,use_quota=True,user_id='7d75cc151dc64c7cab4ad19a67f868b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7751143d-4c80-4aa6-8477-37ef544aa925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7751143d-4c80-4aa6-8477-37ef544aa925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226a39a3-e341-4c52-bace-420c5b6930ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:20:26 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe Sep 01 00:20:26 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:26 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75bcd25c-6dbc-4634-8639-14b321ed48e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8df113-6efd-46d5-a2f4-990ba1fa7b06]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226a39a3-e341-4c52-bace-420c5b6930ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa3bd9b3-e34f-4d8a-92d5-06047e2268c3', 'volume_name': 'volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c407f8de-7e15-43c3-bd4d-f1029cc48de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c407f8de-7e15-43c3-bd4d-f1029cc48de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e82f63-4f96-4079-80aa-6a05b39c6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Trying to clone fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 from image df40e229-b455-4243-a6fd-53ca30610169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:20:27 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 Sep 01 00:20:27 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:20:27 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Image download 20.69 MB at 20.69 MB/s Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c71f5b-893f-4384-8ad4-e5f52ed4166c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:27 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3" returned: 0 in 0.590s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:27 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe Sep 01 00:20:27 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:27 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD Sep 01 00:20:27 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:27 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 is fetched for user 7d75cc151dc64c7cab4ad19a67f868b6. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba45fa8-138a-4326-abbb-609edccabc58]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:27 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe" returned: 0 in 0.459s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:28 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe Sep 01 00:20:28 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:28 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD Sep 01 00:20:28 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:28 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3.6a7d785e-a927-4655-85b6-c094d40616fe" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-6a7d785e-a927-4655-85b6-c094d40616fe" released by "_delete_snapshot" :: held 1.990s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" released by "delete_snapshot" :: held 2.046s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:28 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2005635702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3bd9b3-e34f-4d8a-92d5-06047e2268c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13eef2afc9e4606819cef8ecf13de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:26Z,use_quota=True,user_id='7d75cc151dc64c7cab4ad19a67f868b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Creating volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:28 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:28 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1073741824 Sep 01 00:20:28 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.quota [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Created reservations ['34968f0d-d451-412e-922a-4539053b7c4a', 'efab3d7e-2295-4f4a-bacd-1c83c0503d83', '26d3ef8f-75d5-4354-8744-d888a883dfb4', '0f0e7043-a0a4-4b9b-8510-d99593cc9ff7'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Delete snapshot completed successfully. Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f6fa7462-15ae-4d3e-a0a6-f9c7a2c99da5 req-d39e6357-a594-476f-b845-e55f24ce7485 tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-6a7d785e-a927-4655-85b6-c094d40616fe-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:28 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1073741824" returned: 0 in 0.460s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:28 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 Sep 01 00:20:28 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:29 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Attempting download of df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6290a1-92ba-4013-b66c-7fb7341f90af]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:29 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu Sep 01 00:20:29 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:29 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu" returned: 0 in 0.351s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "cinder-75bcd25c-6dbc-4634-8639-14b321ed48e3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-75bcd25c-6dbc-4634-8639-14b321ed48e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:29 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu Sep 01 00:20:29 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea2694-283f-418d-90ad-d871d5abb386]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:29 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 Sep 01 00:20:29 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:29 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu" returned: 1 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6savjhdu' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1cd4e-b738-44af-aaac-ab1e0d5bfc4e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:30 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD Sep 01 00:20:30 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:30 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:30 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3 Sep 01 00:20:30 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:30 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] df40e229-b455-4243-a6fd-53ca30610169 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:30 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 Sep 01 00:20:30 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:30 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-75bcd25c-6dbc-4634-8639-14b321ed48e3" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-quobyte-75bcd25c-6dbc-4634-8639-14b321ed48e3" released by "delete_volume" :: held 0.845s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.quota [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Created reservations ['06d64e6c-a4e8-4e24-ae9d-5991b5fda670', '20fa6a35-8925-4072-8cb6-43d1dd3aed98', '7225fdbb-49cf-446e-9b16-f833e7aa764b', '706e57a1-2f0d-4bc1-b2d2-28645aa35a88'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:30 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:30 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Flow 'volume_create_manager' (e2427f79-1921-4bdf-9a47-e0acf7fa1741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8ea56c-ee99-4fa3-b5ae-e1bd34b28d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d8ea56c-ee99-4fa3-b5ae-e1bd34b28d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-304471913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7508bb0-c282-41f7-a5f2-99434202dbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dab66b3bad4850b1fd38adca7614e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:31Z,use_quota=True,user_id='132c6964d488484c91ed1979e00a894b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6449580b-83ea-4303-872c-ca74165ed81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6449580b-83ea-4303-872c-ca74165ed81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280bfa8f-dd1a-4e06-86d8-4b853bc093bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:20:31 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.manager [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Deleted volume successfully. Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-96c5cc5b-1df3-459c-9a5e-cd9eba3fe9cb req-d4b2b418-7841-463b-8502-6110e0af13ea tempest-VolumesSnapshotsTestJSON-34530977 None] Lock "cinder-75bcd25c-6dbc-4634-8639-14b321ed48e3-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280bfa8f-dd1a-4e06-86d8-4b853bc093bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7508bb0-c282-41f7-a5f2-99434202dbe1', 'volume_name': 'volume-e7508bb0-c282-41f7-a5f2-99434202dbe1', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd70feb4-f4c7-4583-971b-38b38105eee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd70feb4-f4c7-4583-971b-38b38105eee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdb2755-0d30-4363-ac3a-8ca654edc6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Volume e7508bb0-c282-41f7-a5f2-99434202dbe1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7508bb0-c282-41f7-a5f2-99434202dbe1', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Trying to clone e7508bb0-c282-41f7-a5f2-99434202dbe1 from image df40e229-b455-4243-a6fd-53ca30610169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:20:31 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Image download 20.69 MB at 20.69 MB/s Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[39294a36-5ed7-4bdc-a5e5-84a761c566c6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:32 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD Sep 01 00:20:32 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:32 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 is fetched for user 132c6964d488484c91ed1979e00a894b. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3363ce5-1c0c-4213-b588-12c2448c0fb1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:32 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD Sep 01 00:20:32 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:32 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" returned: 0 in 2.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_gvrebxu2devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:20:32 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Converted 112.00 MB image at 48.23 MB/s Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:32 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1G Sep 01 00:20:32 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:32 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-304471913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7508bb0-c282-41f7-a5f2-99434202dbe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32dab66b3bad4850b1fd38adca7614e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:31Z,use_quota=True,user_id='132c6964d488484c91ed1979e00a894b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Creating volume e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:32 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:32 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1073741824 Sep 01 00:20:32 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:33 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 1G" returned: 0 in 0.382s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Downloaded image df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 for user 7d75cc151dc64c7cab4ad19a67f868b6 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Marking volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Copying metadata from image df40e229-b455-4243-a6fd-53ca30610169 to fa3bd9b3-e34f-4d8a-92d5-06047e2268c3. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Creating volume glance metadata for volume fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 backed by image df40e229-b455-4243-a6fd-53ca30610169 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e82f63-4f96-4079-80aa-6a05b39c6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a521e-7c2f-4620-8efb-3ac0c100682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Volume volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 (fa3bd9b3-e34f-4d8a-92d5-06047e2268c3): created successfully Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f6a521e-7c2f-4620-8efb-3ac0c100682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Flow 'volume_create_manager' (c76ae30b-f669-405b-a6c5-8d6b470be6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8668b21d-0640-4c76-a5f1-756ecd4db2d9 tempest-VolumesImageMetadata-1471568671 None] Created volume successfully. Sep 01 00:20:33 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1073741824" returned: 0 in 0.503s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:33 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 Sep 01 00:20:33 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:33 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1" returned: 0 in 0.248s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Attempting download of df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume e7508bb0-c282-41f7-a5f2-99434202dbe1. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[73165957-859e-410b-9759-7ad78b2b7e6a]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:33 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr Sep 01 00:20:33 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:34 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr Sep 01 00:20:34 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Acquiring lock "cinder-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "cinder-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Acquiring lock "cinder-quobyte-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "cinder-quobyte-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[21525a83-b1b6-4b82-a16a-4f1f918f280f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:34 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr" returned: 1 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_6d7qnmrr' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b65df-ebe9-4f72-8955-3690bb0dbe69]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:34 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 Sep 01 00:20:34 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD Sep 01 00:20:34 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" returned: 0 in 0.380s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:34 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3 Sep 01 00:20:34 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] df40e229-b455-4243-a6fd-53ca30610169 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:34 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 Sep 01 00:20:34 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:34 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "cinder-quobyte-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3" released by "delete_volume" :: held 0.723s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Created reservations ['a549a603-8923-49cd-9019-dd3b12b54767', '033eebb7-d04d-485c-8098-bdddc1949b14', '931fa3a2-6e0b-41ff-97de-1dd56ea72013', 'd8c7b293-fc9f-42fd-b95c-fe688a907189'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:35 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:35 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (a3106d67-1471-4aa7-89a3-046a292d346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06aa9c0-285c-42c9-a961-4a13a4b8b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06aa9c0-285c-42c9-a961-4a13a4b8b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487482036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cb21db-fb02-4721-9ec9-e77e98feca9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:35Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e22e808-ec74-4e8f-8143-fdb93c981f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e22e808-ec74-4e8f-8143-fdb93c981f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fa4e55-e413-45b1-8970-7310f602ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fa4e55-e413-45b1-8970-7310f602ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cb21db-fb02-4721-9ec9-e77e98feca9e', 'volume_name': 'volume-47cb21db-fb02-4721-9ec9-e77e98feca9e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d178dc-8455-4867-8f55-9817523ddacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d178dc-8455-4867-8f55-9817523ddacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4db583-949e-4322-a5d2-a420c7bb4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:35 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Volume 47cb21db-fb02-4721-9ec9-e77e98feca9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cb21db-fb02-4721-9ec9-e77e98feca9e', 'volume_size': 1} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-487482036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cb21db-fb02-4721-9ec9-e77e98feca9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:35Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Creating volume 47cb21db-fb02-4721-9ec9-e77e98feca9e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:35 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e 1073741824 Sep 01 00:20:35 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:35 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Deleted volume successfully. Sep 01 00:20:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aaa47fc8-9d3e-4232-b742-f0e982292a1d tempest-VolumesImageMetadata-1471568671 None] Lock "cinder-fa3bd9b3-e34f-4d8a-92d5-06047e2268c3-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:35 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e 1073741824" returned: 0 in 0.545s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:36 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e Sep 01 00:20:36 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:36 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e" returned: 0 in 0.327s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4db583-949e-4322-a5d2-a420c7bb4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cb21db-fb02-4721-9ec9-e77e98feca9e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18edd7dd-0ee4-400e-8518-c33e8eb5c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Volume volume-47cb21db-fb02-4721-9ec9-e77e98feca9e (47cb21db-fb02-4721-9ec9-e77e98feca9e): created successfully Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18edd7dd-0ee4-400e-8518-c33e8eb5c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (a3106d67-1471-4aa7-89a3-046a292d346b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c1b91f54-00ca-4192-8e16-3e39f9d408cb tempest-VolumesTestJSON-1443237185 None] Created volume successfully. Sep 01 00:20:36 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1" returned: 0 in 1.984s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_of4s2_9qdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:20:36 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Converted 112.00 MB image at 56.39 MB/s Sep 01 00:20:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:36 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1G Sep 01 00:20:36 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:37 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 1G" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Downloaded image df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume e7508bb0-c282-41f7-a5f2-99434202dbe1 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 for user 132c6964d488484c91ed1979e00a894b is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Marking volume e7508bb0-c282-41f7-a5f2-99434202dbe1 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Copying metadata from image df40e229-b455-4243-a6fd-53ca30610169 to e7508bb0-c282-41f7-a5f2-99434202dbe1. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Creating volume glance metadata for volume e7508bb0-c282-41f7-a5f2-99434202dbe1 backed by image df40e229-b455-4243-a6fd-53ca30610169 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdb2755-0d30-4363-ac3a-8ca654edc6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7508bb0-c282-41f7-a5f2-99434202dbe1', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a100d31-99e7-4c83-9303-767de98c49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Volume volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 (e7508bb0-c282-41f7-a5f2-99434202dbe1): created successfully Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a100d31-99e7-4c83-9303-767de98c49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Flow 'volume_create_manager' (e2427f79-1921-4bdf-9a47-e0acf7fa1741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6bf16b0b-011c-42ab-819e-67a65ff4de07 tempest-ServerActionsTestOtherA-721427442 None] Created volume successfully. Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (a8a4665d-a816-46a8-b324-75c6036eed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682e909-078a-41fc-b203-b0c7f896ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682e909-078a-41fc-b203-b0c7f896ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1196561571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c460e2a-cc73-4e0f-a626-16d80fd1e7a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:38Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c240b0-8dcd-437c-89e9-5b4dd1b0b6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c240b0-8dcd-437c-89e9-5b4dd1b0b6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4763fe30-d3bd-477c-90b0-9104d4dd57bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4763fe30-d3bd-477c-90b0-9104d4dd57bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c460e2a-cc73-4e0f-a626-16d80fd1e7a1', 'volume_name': 'volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c92509-b229-4f15-8b68-e0a7c14c7724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c92509-b229-4f15-8b68-e0a7c14c7724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37b4da8-4e44-40eb-93a1-b80e987fe102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Volume 0c460e2a-cc73-4e0f-a626-16d80fd1e7a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1', 'volume_size': 1} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1196561571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c460e2a-cc73-4e0f-a626-16d80fd1e7a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:38Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Creating volume 0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:38 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:38 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 1073741824 Sep 01 00:20:38 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Flow 'volume_create_manager' (3c36f017-5a78-4466-ba35-476b483acdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462805c7-8184-4561-90be-1c7be80b8833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462805c7-8184-4561-90be-1c7be80b8833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-123621767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727bbea5-477d-4eec-9ab7-0f6b5e1bdce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0121f284ed044c3a91648f40a34a88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:38Z,use_quota=True,user_id='6f919e272e9c4acf8081e7c5d56db6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6255a035-78a8-40e7-b3c9-b592959998d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6255a035-78a8-40e7-b3c9-b592959998d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff37b89-ecf8-447a-8b31-7a8640de4700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff37b89-ecf8-447a-8b31-7a8640de4700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727bbea5-477d-4eec-9ab7-0f6b5e1bdce9', 'volume_name': 'volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442dcc36-0601-47c5-8d47-7837f5a407dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442dcc36-0601-47c5-8d47-7837f5a407dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbbd1bc-b520-4e0d-98a7-2e2b1c7b628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Volume 727bbea5-477d-4eec-9ab7-0f6b5e1bdce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9', 'volume_size': 1} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:38 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 1073741824" returned: 0 in 0.534s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:38 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 Sep 01 00:20:38 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:38 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" returned: 0 in 0.248s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-123621767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727bbea5-477d-4eec-9ab7-0f6b5e1bdce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0121f284ed044c3a91648f40a34a88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:38Z,use_quota=True,user_id='6f919e272e9c4acf8081e7c5d56db6cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Creating volume 727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:38 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37b4da8-4e44-40eb-93a1-b80e987fe102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3ccb79-8c4f-4530-b92c-1c1084d32944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:39 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 1073741824 Sep 01 00:20:39 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Volume volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 (0c460e2a-cc73-4e0f-a626-16d80fd1e7a1): created successfully Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3ccb79-8c4f-4530-b92c-1c1084d32944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (a8a4665d-a816-46a8-b324-75c6036eed5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b9f3a3d0-12ad-40b0-9ded-094d85f761de tempest-VolumesTestJSON-1443237185 None] Created volume successfully. Sep 01 00:20:39 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 1073741824" returned: 0 in 0.479s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:39 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 Sep 01 00:20:39 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:39 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbbd1bc-b520-4e0d-98a7-2e2b1c7b628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d75a7-9eab-41e2-87c2-890ac7d0378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Volume volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 (727bbea5-477d-4eec-9ab7-0f6b5e1bdce9): created successfully Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d75a7-9eab-41e2-87c2-890ac7d0378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Flow 'volume_create_manager' (3c36f017-5a78-4466-ba35-476b483acdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8f9cafdd-78a2-45d0-adf9-dd0ef4e17af8 tempest-SnapshotMetadataTestJSON-1746584814 None] Created volume successfully. Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-91adfbd5-41e3-45ea-93be-3e39430ab396 req-ce4da173-f967-4cf6-b0aa-6f883ff39951 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-91adfbd5-41e3-45ea-93be-3e39430ab396 req-ce4da173-f967-4cf6-b0aa-6f883ff39951 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-91adfbd5-41e3-45ea-93be-3e39430ab396 req-ce4da173-f967-4cf6-b0aa-6f883ff39951 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-91adfbd5-41e3-45ea-93be-3e39430ab396 req-ce4da173-f967-4cf6-b0aa-6f883ff39951 tempest-ServerActionsTestOtherA-721427442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-e7508bb0-c282-41f7-a5f2-99434202dbe1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c73c0141-a28a-464b-8a2a-a3ca0703616c', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:20:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-91adfbd5-41e3-45ea-93be-3e39430ab396 req-ce4da173-f967-4cf6-b0aa-6f883ff39951 tempest-ServerActionsTestOtherA-721427442 None] attachment_update completed successfully. Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (9fa8ef96-c14d-4e3c-967d-e7840a31fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1614400-6069-4def-a9d5-3f1aa726ab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1614400-6069-4def-a9d5-3f1aa726ab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-759818709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7cf81f-2108-498a-8b3e-c064f065c058,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:41Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa21d51e-1d08-4a72-a79f-a5a1098293e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa21d51e-1d08-4a72-a79f-a5a1098293e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ae4b3b-d133-42a2-962d-d9cb7705831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ae4b3b-d133-42a2-962d-d9cb7705831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7cf81f-2108-498a-8b3e-c064f065c058', 'volume_name': 'volume-0a7cf81f-2108-498a-8b3e-c064f065c058', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a29d681-9110-4162-83ff-92856a96c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a29d681-9110-4162-83ff-92856a96c40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3337a9cc-57e7-4cc6-927b-9b439fe1f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Volume 0a7cf81f-2108-498a-8b3e-c064f065c058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7cf81f-2108-498a-8b3e-c064f065c058', 'volume_size': 1} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-759818709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7cf81f-2108-498a-8b3e-c064f065c058,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='991777ded88d42f891a580a94547f601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:20:41Z,use_quota=True,user_id='01d9317a9d8b4ca0a8cc48205e9b101e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Creating volume 0a7cf81f-2108-498a-8b3e-c064f065c058 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:20:40 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:20:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:40 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 1073741824 Sep 01 00:20:40 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:41 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 1073741824" returned: 0 in 0.494s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:41 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 Sep 01 00:20:41 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:41 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.787s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3337a9cc-57e7-4cc6-927b-9b439fe1f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7cf81f-2108-498a-8b3e-c064f065c058', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85c6439-4bb2-4758-b1cc-45f4a544fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Creating offline snapshot 7eb3b4b8-18bd-4025-ac80-847779f95387 of volume 727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:20:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Volume volume-0a7cf81f-2108-498a-8b3e-c064f065c058 (0a7cf81f-2108-498a-8b3e-c064f065c058): created successfully Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85c6439-4bb2-4758-b1cc-45f4a544fd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Flow 'volume_create_manager' (9fa8ef96-c14d-4e3c-967d-e7840a31fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c85fdf-e5f8-4a29-9b64-9cbfeb6ede8b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c210456-1a34-4929-bc16-13c0a1e34365 tempest-VolumesTestJSON-1443237185 None] Created volume successfully. Sep 01 00:20:41 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 Sep 01 00:20:41 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:42 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:42 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 1G Sep 01 00:20:42 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:42 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 1G" returned: 0 in 0.475s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:42 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 Sep 01 00:20:42 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:43 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387" returned: 0 in 0.520s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:43 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 is being set with open permissions: ugo+rw Sep 01 00:20:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:43 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 Sep 01 00:20:43 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:43 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387" returned: 0 in 0.377s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:43 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info Sep 01 00:20:43 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:44 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info" returned: 0 in 0.383s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:44 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info is being set with open permissions: ugo+rw Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:44 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info Sep 01 00:20:44 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-0a7cf81f-2108-498a-8b3e-c064f065c058-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "cinder-0a7cf81f-2108-498a-8b3e-c064f065c058-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-quobyte-0a7cf81f-2108-498a-8b3e-c064f065c058" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-0a7cf81f-2108-498a-8b3e-c064f065c058" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026fc30-856f-4507-86e0-9e4b7ad63b7b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:44 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.info" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:44 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:44 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-66c81f89-c44c-4cd6-983e-6f1f90b08f4d tempest-SnapshotMetadataTestJSON-1746584814 None] Create snapshot completed successfully Sep 01 00:20:44 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:44 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058 Sep 01 00:20:44 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:44 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0a7cf81f-2108-498a-8b3e-c064f065c058" returned: 0 in 0.285s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-0a7cf81f-2108-498a-8b3e-c064f065c058" released by "delete_volume" :: held 0.731s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Created reservations ['5156068c-4165-4e80-bbcd-a2ecc9ccd37f', '80afda4b-e45e-4f77-81de-a3387a0cba60', 'ab907abe-4222-448b-b1de-197fdf943b10', '09fa3487-9666-4ce1-9d53-0a7e4d70bdca'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:45 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:45 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "cinder-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-quobyte-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6013657-180d-4457-87b5-44b1691f3220]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:45 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.379s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Deleted volume successfully. Sep 01 00:20:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c7290a6-6ebf-41c3-ba05-3920ae987dff tempest-VolumesTestJSON-1443237185 None] Lock "cinder-0a7cf81f-2108-498a-8b3e-c064f065c058-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:45 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 Sep 01 00:20:45 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:46 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "cinder-7eb3b4b8-18bd-4025-ac80-847779f95387-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" returned: 0 in 0.476s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-7eb3b4b8-18bd-4025-ac80-847779f95387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "cinder-quobyte-7eb3b4b8-18bd-4025-ac80-847779f95387" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:46 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1 Sep 01 00:20:46 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-7eb3b4b8-18bd-4025-ac80-847779f95387" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Deleting offline snapshot 7eb3b4b8-18bd-4025-ac80-847779f95387 of volume 727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] snapshot_file for this snap is: volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171cac4-25a1-44e2-85ee-ae3363118098]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:46 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 Sep 01 00:20:46 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:46 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" returned: 0 in 0.402s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1" released by "delete_volume" :: held 0.948s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Created reservations ['dee1983a-2f28-4e43-86b4-67ceeaa8f543', '9cc42717-4d0b-4f13-86ea-e6001c31dc1e', '411f6637-db7d-441c-9ba9-c2f36f665dab', '68f737cb-ed61-46b1-be7f-db2986144cdd'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:46 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387" returned: 0 in 0.634s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:20:46 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:46 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4341c-d912-45c8-bd96-f43a71e55393]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:47 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 Sep 01 00:20:47 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:47 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.717s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Deleted volume successfully. Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ae60cbb-f7e6-4d24-85b5-cc4e551c4144 tempest-VolumesTestJSON-1443237185 None] Lock "cinder-0c460e2a-cc73-4e0f-a626-16d80fd1e7a1-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:47 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" returned: 0 in 0.834s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:47 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 Sep 01 00:20:47 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-47cb21db-fb02-4721-9ec9-e77e98feca9e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "cinder-47cb21db-fb02-4721-9ec9-e77e98feca9e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Acquiring lock "cinder-quobyte-47cb21db-fb02-4721-9ec9-e77e98feca9e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-47cb21db-fb02-4721-9ec9-e77e98feca9e" acquired by "delete_volume" :: waited 0.059s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26169554-f221-45f0-9406-9d203164da58]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:48 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387" returned: 0 in 0.729s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:48 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e Sep 01 00:20:48 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:48 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387 Sep 01 00:20:48 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:49 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9.7eb3b4b8-18bd-4025-ac80-847779f95387" returned: 0 in 0.563s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:49 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e" returned: 0 in 0.899s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:49 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e Sep 01 00:20:49 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-7eb3b4b8-18bd-4025-ac80-847779f95387" released by "_delete_snapshot" :: held 3.073s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" released by "delete_snapshot" :: held 3.125s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Created reservations ['31da6917-9e8a-440a-8d63-67d38b4f48fa', '87ee19a9-dd35-42f5-9e37-9cc33d7a90e1', '89b8a247-629c-4411-bfde-e63b3c1d2566', '1ba53fa8-6d54-482d-be8a-985d7552c91a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:49 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-47cb21db-fb02-4721-9ec9-e77e98feca9e" returned: 0 in 0.523s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "cinder-quobyte-47cb21db-fb02-4721-9ec9-e77e98feca9e" released by "delete_volume" :: held 1.542s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Delete snapshot completed successfully. Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a2a5aeb-6478-46e7-aed7-286d16c84f61 tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-7eb3b4b8-18bd-4025-ac80-847779f95387-delete_snapshot" released by "delete_snapshot" :: held 3.603s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Created reservations ['7da56ce7-13d6-4253-b0ba-040e4f772612', '49267ed5-7d12-4120-832b-cd946553d919', 'fc1489c6-07e9-474e-937d-2fc812f1dea1', 'b8ab7b73-07e5-411b-8fbf-39e6aedb2b0c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:49 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:49 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:50 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.617s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Deleted volume successfully. Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2e307272-41f5-47f4-9e4f-ac7379749bba tempest-VolumesTestJSON-1443237185 None] Lock "cinder-47cb21db-fb02-4721-9ec9-e77e98feca9e-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "cinder-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:20:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" acquired by "delete_volume" :: waited 0.093s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:20:51 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[745be391-0d9b-4d69-9af5-95ef9a213f67]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:20:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:51 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 Sep 01 00:20:51 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:51 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" returned: 0 in 0.820s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:52 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9 Sep 01 00:20:52 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:52 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" returned: 0 in 0.611s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-quobyte-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9" released by "delete_volume" :: held 1.603s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:20:52 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Created reservations ['748e9625-a1fa-41ba-9af7-b79df8dd2ad9', '1587f132-4efa-408b-ba37-34552b6555f7', '68fd8119-a554-40c9-ab75-bad66c6abacf', '53a6bdb3-6ae3-420a-b333-9dcb6dce723c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:20:53 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:20:53 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:20:53 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:20:53 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Deleted volume successfully. Sep 01 00:20:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bb816f2f-dd9a-40a9-be31-1aeceb95274a tempest-SnapshotMetadataTestJSON-1746584814 None] Lock "cinder-727bbea5-477d-4eec-9ab7-0f6b5e1bdce9-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (f224b3e6-c014-4890-800b-7fb5f8d4561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a9b22-328e-4329-b1d8-777a15e507be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a9b22-328e-4329-b1d8-777a15e507be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-866199550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fbbb322c594ee7a70821166485ac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:00Z,use_quota=True,user_id='5464ab39c44b4e87849a0010a20bce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778f8cc7-7b91-47fa-a8bf-cc9c1466a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778f8cc7-7b91-47fa-a8bf-cc9c1466a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de27c798-4d67-488a-a262-e616ad44ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de27c798-4d67-488a-a262-e616ad44ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd', 'volume_name': 'volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a87f37c-790b-4f3f-87f4-acdfffc62f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a87f37c-790b-4f3f-87f4-acdfffc62f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5bf849-356a-4a4c-bc9a-1c9e7c57240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd', 'volume_size': 1} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-866199550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fbbb322c594ee7a70821166485ac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:00Z,use_quota=True,user_id='5464ab39c44b4e87849a0010a20bce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Creating volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:00 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd 1073741824 Sep 01 00:21:00 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:00 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-a2017a83-371b-405e-a28f-2f1593a2fb4b tempest-ServerActionsTestOtherA-721427442 None] Terminate volume connection completed successfully. Sep 01 00:21:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-a2017a83-371b-405e-a28f-2f1593a2fb4b tempest-ServerActionsTestOtherA-721427442 None] Deleting attachment c73c0141-a28a-464b-8a2a-a3ca0703616c. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:21:01 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd 1073741824" returned: 0 in 0.900s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:01 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:01 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:01 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 0.378s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5bf849-356a-4a4c-bc9a-1c9e7c57240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628b52c8-16a4-4d20-ba66-70429f8bf257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:01 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Volume volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd (4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd): created successfully Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628b52c8-16a4-4d20-ba66-70429f8bf257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (f224b3e6-c014-4890-800b-7fb5f8d4561d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-09f82589-c287-4b00-a8d1-30d6150f736c tempest-VolumesDeleteCascade-1219196199 None] Created volume successfully. Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Creating offline snapshot 39503a45-7767-428b-836a-49968694e2ec of volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29b88f-49b8-4815-ab59-3198088d8768]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:02 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:02 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:02 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 0.474s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:03 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec 1G Sep 01 00:21:03 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-4b5d6ae3-ea34-43c8-8440-f00de68efa20 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:03 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec 1G" returned: 0 in 0.598s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:03 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:03 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:04 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.473s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec is being set with open permissions: ugo+rw Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:04 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:04 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:04 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=108,cinder:UPDATE=115,cinder:INSERT=45,cinder:DELETE=13 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=111,cinder:UPDATE=113,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:04 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info Sep 01 00:21:04 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:04 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info is being set with open permissions: ugo+rw Sep 01 00:21:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:04 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info Sep 01 00:21:04 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:05 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.info" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-4b5d6ae3-ea34-43c8-8440-f00de68efa20 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.055s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-4b5d6ae3-ea34-43c8-8440-f00de68efa20 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6595a6eb-2ce5-4546-aa1d-cb2838b52c5a tempest-VolumesDeleteCascade-1219196199 None] Create snapshot completed successfully Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-4b5d6ae3-ea34-43c8-8440-f00de68efa20 tempest-ServerActionsTestOtherA-721427442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-e7508bb0-c282-41f7-a5f2-99434202dbe1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6ff81b2-0cd9-4adf-85c4-316e26e01330', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:21:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-f3818319-a78b-4130-a2e6-572be98ca1ad req-4b5d6ae3-ea34-43c8-8440-f00de68efa20 tempest-ServerActionsTestOtherA-721427442 None] attachment_update completed successfully. Sep 01 00:21:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f0665093-0454-4a61-98e6-9f921c3814d4 tempest-GroupsV314Test-1518647452 None] Group tempest-GroupsV314Test-Group-1490559621: creating Sep 01 00:21:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f0665093-0454-4a61-98e6-9f921c3814d4 tempest-GroupsV314Test-1518647452 None] Group tempest-GroupsV314Test-Group-1490559621: created successfully Sep 01 00:21:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f0665093-0454-4a61-98e6-9f921c3814d4 tempest-GroupsV314Test-1518647452 None] Create group completed successfully. Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Creating offline snapshot c55ae303-83a0-42ac-9005-12aa67a09665 of volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e0bf0-047e-4147-9836-81378d8f455f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:06 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:06 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:06 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.757s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:06 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 1G Sep 01 00:21:06 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:07 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 1G" returned: 0 in 0.927s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:07 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:07 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Flow 'volume_create_manager' (47e5caa8-adf5-4656-8827-836c3caa5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b309918a-4277-407f-9998-d640d7827a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b309918a-4277-407f-9998-d640d7827a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733526847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7530446a-f088-45d4-83da-cf9ec9e560e3,host='devstack@QuobyteHD#QuobyteHD',id=ac0f012f-afa7-40ef-9edd-48dd911caeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ee6d7d6a414efcbe8b1b79b7bc3cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:08Z,use_quota=True,user_id='ba172d4f6b774206bee44c8804107978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(861a25d9-6d91-47d6-b084-db9fab99bac3),volume_type_id=861a25d9-6d91-47d6-b084-db9fab99bac3)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6607cd0f-9331-4b48-81cb-e2eaf5e67178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6607cd0f-9331-4b48-81cb-e2eaf5e67178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5faece-8604-4fcd-a7b9-2d36d898d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5faece-8604-4fcd-a7b9-2d36d898d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0f012f-afa7-40ef-9edd-48dd911caeb2', 'volume_name': 'volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a9e9e-1145-484b-ab9a-935504554f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a9e9e-1145-484b-ab9a-935504554f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a013fc0-451e-46b3-9ec0-b2087cd81711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:08 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Volume ac0f012f-afa7-40ef-9edd-48dd911caeb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2', 'volume_size': 1} Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:08 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.816s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:08 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 is being set with open permissions: ugo+rw Sep 01 00:21:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:08 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:08 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:09 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.489s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7530446a-f088-45d4-83da-cf9ec9e560e3,created_at=2026-08-31T22:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-733526847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7530446a-f088-45d4-83da-cf9ec9e560e3,host='devstack@QuobyteHD#QuobyteHD',id=ac0f012f-afa7-40ef-9edd-48dd911caeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ee6d7d6a414efcbe8b1b79b7bc3cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:08Z,use_quota=True,user_id='ba172d4f6b774206bee44c8804107978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(861a25d9-6d91-47d6-b084-db9fab99bac3),volume_type_id=861a25d9-6d91-47d6-b084-db9fab99bac3)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Creating volume ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:09 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-596bac45-1172-4543-913b-0def5934bb07 tempest-VolumesDeleteCascade-1219196199 None] Create snapshot completed successfully Sep 01 00:21:09 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 1073741824 Sep 01 00:21:09 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:10 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 1073741824" returned: 0 in 1.011s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:10 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:10 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Performing cascade delete. {{(pid=87803) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 00:21:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-39503a45-7767-428b-836a-49968694e2ec-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-39503a45-7767-428b-836a-49968694e2ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-39503a45-7767-428b-836a-49968694e2ec" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-39503a45-7767-428b-836a-49968694e2ec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:11 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Deleting offline snapshot 39503a45-7767-428b-836a-49968694e2ec of volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] snapshot_file for this snap is: volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 0.755s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a013fc0-451e-46b3-9ec0-b2087cd81711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793a1c18-e622-4d28-9d04-861d3d5fa6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f0e6b-2e7d-4f24-aac4-8b3003a6a8a9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:11 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Volume volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 (ac0f012f-afa7-40ef-9edd-48dd911caeb2): created successfully Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793a1c18-e622-4d28-9d04-861d3d5fa6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Flow 'volume_create_manager' (47e5caa8-adf5-4656-8827-836c3caa5d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ce9e3dea-a767-428a-bedb-e3b6187f116b tempest-GroupsV314Test-1518647452 None] Created volume successfully. Sep 01 00:21:11 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:11 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:11 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.776s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9502d52-73cd-4063-b3d2-7306e00196df]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:12 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:12 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:13 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 0.982s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb856f-522b-4ebb-8254-38a83350ccb7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:13 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:13 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:13 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:13 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:14 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.982s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[41829235-9eb8-4507-a795-94ffc94e2786]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:14 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Cloning volume ac0f012f-afa7-40ef-9edd-48dd911caeb2 to volume e119fb94-2ea9-4848-a008-d66d3dedaf16 Sep 01 00:21:14 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.929s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:14 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:14 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Creating offline snapshot 2ec4d2fa-b85d-45bb-bba0-5c6253242e46 of volume ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b09e62-a3f7-41f1-8fa8-35de7ca904d9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:15 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:15 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:15 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.979s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950e72c-e45a-42ee-a87f-f130ea0de74e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:15 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:15 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:15 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 1.042s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:15 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 1G Sep 01 00:21:15 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:16 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 0.858s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:16 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:16 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:16 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 1G" returned: 0 in 0.825s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:16 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:16 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:16 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.728s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:16 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec Sep 01 00:21:16 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:17 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.542s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:17 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:17 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:17 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:17 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.39503a45-7767-428b-836a-49968694e2ec" returned: 0 in 0.378s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 -F qcow2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:17 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 -F qcow2 Sep 01 00:21:17 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:17 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.303s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:17 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info Sep 01 00:21:17 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:17 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 -F qcow2" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-39503a45-7767-428b-836a-49968694e2ec" released by "_delete_snapshot" :: held 6.567s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" released by "delete_snapshot" :: held 6.607s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['349df820-970d-458d-a28d-4e0ab0b88f37', 'b07ff6a2-bebe-4f8e-8d74-d678cfbed557', '94240708-8153-4eb4-bc02-1e2b171dff39', '5ab2944f-fd38-479c-820d-606b66ab9cc1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:17 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Delete snapshot completed successfully. Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info" returned: 0 in 0.336s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:17 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-39503a45-7767-428b-836a-49968694e2ec-delete_snapshot" released by "delete_snapshot" :: held 6.848s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-c55ae303-83a0-42ac-9005-12aa67a09665-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-c55ae303-83a0-42ac-9005-12aa67a09665-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:17 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info Sep 01 00:21:17 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-c55ae303-83a0-42ac-9005-12aa67a09665" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-c55ae303-83a0-42ac-9005-12aa67a09665" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Deleting offline snapshot c55ae303-83a0-42ac-9005-12aa67a09665 of volume 4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:21:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] snapshot_file for this snap is: volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[78207a6f-415f-4029-adb3-9b5d7f95cba4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:18 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.info" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Acquiring lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:18 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:18 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] snapshot: 2ec4d2fa-b85d-45bb-bba0-5c6253242e46, volume: e119fb94-2ea9-4848-a008-d66d3dedaf16, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1881243c-d4a3-472e-ad00-e7c2d7235f18]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:18 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:18 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.550s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:18 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b5621-7930-44da-87d2-a15e7132f14e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:18 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.487s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:18 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:18 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[db048454-108e-4f73-9bb0-28fa0cab4104]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:18 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:18 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:19 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 0.456s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:19 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:19 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:19 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 0.528s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:19 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 Sep 01 00:21:19 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:19 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.520s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:19 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665 Sep 01 00:21:19 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:20 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd.c55ae303-83a0-42ac-9005-12aa67a09665" returned: 0 in 0.496s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-c55ae303-83a0-42ac-9005-12aa67a09665" released by "_delete_snapshot" :: held 2.276s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" released by "delete_snapshot" :: held 2.346s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['f18ee796-e112-4297-8bcc-c77e35a57337', '91f387ad-1ceb-49f6-9ab5-5047054f25c5', 'd82d659e-afbe-4c19-a7e0-b43f1ca0d4a9', '82dda078-9589-48ef-aac6-53e83e22c0f0'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Delete snapshot completed successfully. Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-c55ae303-83a0-42ac-9005-12aa67a09665-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Snapshots deleted, issuing volume delete {{(pid=87803) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 00:21:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" acquired by "delete_volume" :: waited 0.086s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:21 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc32abb-2fb3-4879-a401-94503e597e8d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:21 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:21 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:22 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 1.564s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:22 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd Sep 01 00:21:22 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:23 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" returned: 0 in 1.178s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd" released by "delete_volume" :: held 2.972s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['5a4a9d98-eb95-48d9-9d01-f3419461f845', '08cf13c0-0d11-4ed8-8d6e-db17ee998337', '1bcc69e6-2aba-491d-93f1-639e425dbc94', 'fdde58ce-43aa-4c76-a667-09d439fbcb1b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:24 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:24 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:25 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 1.029s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:25 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Deleted volume successfully. Sep 01 00:21:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df2830e0-56fd-40c8-8c23-3d3e4a7eead1 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-4cff4e86-3c8a-46e7-a1e5-5ba42aa035bd-delete_volume" released by "delete_volume" :: held 15.019s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:27 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16" returned: 0 in 7.933s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:21:27 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Converted 1024.00 MB image at 129.07 MB/s Sep 01 00:21:27 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:27 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 Sep 01 00:21:27 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (8fb665f7-3854-49b2-b8ac-5edbd0dd7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a145c7-4041-4221-b450-b9ff603c4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a145c7-4041-4221-b450-b9ff603c4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-712962751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2003a444-b07c-4e00-9623-f6887b355c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fbbb322c594ee7a70821166485ac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:27Z,use_quota=True,user_id='5464ab39c44b4e87849a0010a20bce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb433cbd-fdd5-4bf0-a904-fcaf7c042ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb433cbd-fdd5-4bf0-a904-fcaf7c042ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8a14a2-2d92-4a1f-b4cd-ae913d936c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8a14a2-2d92-4a1f-b4cd-ae913d936c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2003a444-b07c-4e00-9623-f6887b355c06', 'volume_name': 'volume-2003a444-b07c-4e00-9623-f6887b355c06', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acd1c8d-e990-4204-8797-7c5364901a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acd1c8d-e990-4204-8797-7c5364901a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3225ef79-37c3-4543-aed0-cb5d39b23a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Volume 2003a444-b07c-4e00-9623-f6887b355c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2003a444-b07c-4e00-9623-f6887b355c06', 'volume_size': 1} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:27 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" released by "_copy_volume_from_snapshot" :: held 9.324s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Acquiring lock "cinder-quobyte-2ec4d2fa-b85d-45bb-bba0-5c6253242e46" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-2ec4d2fa-b85d-45bb-bba0-5c6253242e46" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Deleting offline snapshot 2ec4d2fa-b85d-45bb-bba0-5c6253242e46 of volume ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] snapshot_file for this snap is: volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd51ce-ae0f-4850-b010-e227a663f490]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:27 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:27 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:28 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.411s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98a8b9-9424-479c-b0ea-c95136044d87]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:28 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:28 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:28 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 0.530s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:28 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:28 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:29 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:29 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46 Sep 01 00:21:29 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:29 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2.2ec4d2fa-b85d-45bb-bba0-5c6253242e46" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-2ec4d2fa-b85d-45bb-bba0-5c6253242e46" released by "_delete_snapshot" :: held 1.696s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.932s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.974s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-712962751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2003a444-b07c-4e00-9623-f6887b355c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fbbb322c594ee7a70821166485ac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:27Z,use_quota=True,user_id='5464ab39c44b4e87849a0010a20bce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Creating volume 2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:29 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 1073741824 Sep 01 00:21:29 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ffe2d814-ce7e-4e1c-96ea-77cede2c752b tempest-GroupsV314Test-1518647452 None] Create group from source-group-7530446a-f088-45d4-83da-cf9ec9e560e3 completed successfully. Sep 01 00:21:29 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 1073741824" returned: 0 in 0.419s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:29 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:29 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:30 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.237s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3225ef79-37c3-4543-aed0-cb5d39b23a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2003a444-b07c-4e00-9623-f6887b355c06', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aef68f-8158-4d19-9397-fdf083d20600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Volume volume-2003a444-b07c-4e00-9623-f6887b355c06 (2003a444-b07c-4e00-9623-f6887b355c06): created successfully Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aef68f-8158-4d19-9397-fdf083d20600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (8fb665f7-3854-49b2-b8ac-5edbd0dd7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c03238ee-7189-41a5-aa0e-a9c1cfbfd7ed tempest-VolumesDeleteCascade-1219196199 None] Created volume successfully. Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Creating offline snapshot bb2952e2-1a06-4552-a4b8-29fc652bcf04 of volume 2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87a421-4266-4b11-bea5-81ae7384a723]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:30 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:30 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Acquiring lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbbf074-2e0d-4622-b18b-6592e47191ff]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:30 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 Sep 01 00:21:30 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:30 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.369s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:30 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 1G Sep 01 00:21:30 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:31 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16" returned: 0 in 0.373s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:31 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16 Sep 01 00:21:31 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:31 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e119fb94-2ea9-4848-a008-d66d3dedaf16" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-e119fb94-2ea9-4848-a008-d66d3dedaf16" released by "delete_volume" :: held 0.692s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:31 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 1G" returned: 0 in 0.477s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2003a444-b07c-4e00-9623-f6887b355c06 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:31 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2003a444-b07c-4e00-9623-f6887b355c06 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:31 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Created reservations ['8733d83d-b605-4dee-b666-e90d1ec92216'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:31 devstack cinder-volume[87803]: WARNING cinder.quota [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1334292998 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1334292998, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:21:31 devstack cinder-volume[87803]: WARNING cinder.quota [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1334292998 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1334292998, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Created reservations ['19812ad1-d7be-43be-9a1e-586b31700ca3', 'e737b656-249c-49c4-8484-4f3726b4eb4d', '60765efe-a1b3-48c5-b0b6-c1c7b64d0834', 'e1ab4a63-f798-4e84-b3c8-9573079010c3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:31 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:31 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:31 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2003a444-b07c-4e00-9623-f6887b355c06 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.310s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:31 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 is being set with open permissions: ugo+rw Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:31 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:31 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:31 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.291s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:31 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e50f6f97-f8fd-4b16-bd8c-aea4258988fc tempest-GroupsV314Test-1518647452 None] Delete group completed successfully. Sep 01 00:21:31 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:32 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info Sep 01 00:21:32 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Acquiring lock "cinder-quobyte-ac0f012f-afa7-40ef-9edd-48dd911caeb2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-ac0f012f-afa7-40ef-9edd-48dd911caeb2" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c679d9eb-aa0b-422a-96d4-cf107d657452]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:32 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:32 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info is being set with open permissions: ugo+rw Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:32 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info Sep 01 00:21:32 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:32 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:32 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:32 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.info" returned: 0 in 0.265s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:32 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-617a824e-cddc-443a-b66c-39e126a54969 tempest-VolumesDeleteCascade-1219196199 None] Create snapshot completed successfully Sep 01 00:21:32 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2 Sep 01 00:21:32 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:32 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac0f012f-afa7-40ef-9edd-48dd911caeb2" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Lock "cinder-quobyte-ac0f012f-afa7-40ef-9edd-48dd911caeb2" released by "delete_volume" :: held 0.732s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:32 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Created reservations ['35ae71d9-846b-48d6-93cb-dcda78501c05'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Created reservations ['d5c346d1-174d-46be-af4b-ccf6225802ec', 'f76abbea-3afb-4569-a8e8-6d1cae917f22', 'd7e8cb0b-cd02-4606-8964-0bfd42bc6f94', '519eac63-49cb-426e-bce4-f1e5857e7482'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:33 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:33 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:33 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:33 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-308e8b49-1314-4eb3-b6af-2b42de08dae7 tempest-GroupsV314Test-1518647452 None] Delete group completed successfully. Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (522d1743-3706-48da-a94e-f7e3ccb34bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab8971-5ef0-4b44-b030-067cd74d0e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cab8971-5ef0-4b44-b030-067cd74d0e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1828756077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f31e524-8684-4257-a2ce-e0db3b4a8477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9fbbb322c594ee7a70821166485ac50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb2952e2-1a06-4552-a4b8-29fc652bcf04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:34Z,use_quota=True,user_id='5464ab39c44b4e87849a0010a20bce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74b9beb-57d0-48fd-ac3b-05a6ce6b45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74b9beb-57d0-48fd-ac3b-05a6ce6b45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc30bc4f-f191-47a3-8294-b63f898d3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc30bc4f-f191-47a3-8294-b63f898d3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f31e524-8684-4257-a2ce-e0db3b4a8477', 'volume_name': 'volume-0f31e524-8684-4257-a2ce-e0db3b4a8477', 'volume_size': 1, 'snapshot_id': 'bb2952e2-1a06-4552-a4b8-29fc652bcf04'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e9d78d-51b4-48c2-92fc-0de3ba18d4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e9d78d-51b4-48c2-92fc-0de3ba18d4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42736e8-aad4-40f2-961a-4a346af7897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Volume 0f31e524-8684-4257-a2ce-e0db3b4a8477: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f31e524-8684-4257-a2ce-e0db3b4a8477', 'volume_size': 1, 'snapshot_id': 'bb2952e2-1a06-4552-a4b8-29fc652bcf04'} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04-0f31e524-8684-4257-a2ce-e0db3b4a8477" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04-0f31e524-8684-4257-a2ce-e0db3b4a8477" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Creating volume 0f31e524-8684-4257-a2ce-e0db3b4a8477 from snapshot bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] snapshot: bb2952e2-1a06-4552-a4b8-29fc652bcf04, volume: 0f31e524-8684-4257-a2ce-e0db3b4a8477, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d95adf-4721-470d-ba12-1c2c91479a57]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:34 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:34 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:34 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2003a444-b07c-4e00-9623-f6887b355c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c09668d-a3d1-4773-9879-5669ac4827e2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:34 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:34 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:35 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.415s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:21:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:21:35 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:21:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:35 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 Sep 01 00:21:35 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (71c4923e-ce61-430e-b20d-d5e708277b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db1826c-fa51-4ec1-94aa-6970b5ea6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db1826c-fa51-4ec1-94aa-6970b5ea6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749918105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fc4155-3ccf-4128-8d5e-0a64797e2265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:36Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d726f34-4653-4c06-9836-790ce3af8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d726f34-4653-4c06-9836-790ce3af8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ee54b-bdcf-415d-a057-4c650c9b462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ee54b-bdcf-415d-a057-4c650c9b462a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fc4155-3ccf-4128-8d5e-0a64797e2265', 'volume_name': 'volume-35fc4155-3ccf-4128-8d5e-0a64797e2265', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb90a24-f2d5-4e24-87a0-9b34c6b4cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb90a24-f2d5-4e24-87a0-9b34c6b4cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e468b-5958-4b1b-b1ab-6a3a068067ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Volume 35fc4155-3ccf-4128-8d5e-0a64797e2265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fc4155-3ccf-4128-8d5e-0a64797e2265', 'volume_size': 1} Sep 01 00:21:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:41 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477" returned: 0 in 6.238s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:21:41 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Converted 1024.00 MB image at 164.14 MB/s Sep 01 00:21:41 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 is being set with open permissions: ugo+rw Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:41 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 Sep 01 00:21:41 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:41 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477" returned: 0 in 0.262s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" released by "_copy_volume_from_snapshot" :: held 7.402s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04-0f31e524-8684-4257-a2ce-e0db3b4a8477" released by "_create_volume_from_snapshot" :: held 7.482s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.498s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.044s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749918105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fc4155-3ccf-4128-8d5e-0a64797e2265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:36Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Creating volume 35fc4155-3ccf-4128-8d5e-0a64797e2265 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42736e8-aad4-40f2-961a-4a346af7897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f31e524-8684-4257-a2ce-e0db3b4a8477', 'volume_size': 1, 'snapshot_id': 'bb2952e2-1a06-4552-a4b8-29fc652bcf04'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3086707-1cd6-4451-9e8c-e880c7ea4d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:41 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 1073741824 Sep 01 00:21:41 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Volume volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 (0f31e524-8684-4257-a2ce-e0db3b4a8477): created successfully Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3086707-1cd6-4451-9e8c-e880c7ea4d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Flow 'volume_create_manager' (522d1743-3706-48da-a94e-f7e3ccb34bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-71f566c2-fcaf-4a7e-aa86-eae0bd2cb999 tempest-VolumesDeleteCascade-1219196199 None] Created volume successfully. Sep 01 00:21:42 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 1073741824" returned: 0 in 0.671s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-67f9b1ac-739d-4230-a596-5ebbf44f1712 tempest-GroupsV320Test-115766598 None] Group tempest-GroupsV320Test-Group-2069508214: creating Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-67f9b1ac-739d-4230-a596-5ebbf44f1712 tempest-GroupsV320Test-115766598 None] Group tempest-GroupsV320Test-Group-2069508214: created successfully Sep 01 00:21:42 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 Sep 01 00:21:42 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-67f9b1ac-739d-4230-a596-5ebbf44f1712 tempest-GroupsV320Test-115766598 None] Create group completed successfully. Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-2003a444-b07c-4e00-9623-f6887b355c06-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-2003a444-b07c-4e00-9623-f6887b355c06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Performing cascade delete. {{(pid=87803) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-bb2952e2-1a06-4552-a4b8-29fc652bcf04-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-bb2952e2-1a06-4552-a4b8-29fc652bcf04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Deleting offline snapshot bb2952e2-1a06-4552-a4b8-29fc652bcf04 of volume 2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] snapshot_file for this snap is: volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7422240f-1a32-4e31-a678-48f56bb348db]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:42 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265" returned: 0 in 0.319s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e468b-5958-4b1b-b1ab-6a3a068067ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fc4155-3ccf-4128-8d5e-0a64797e2265', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f75404-f5d7-4863-97cc-3744fdc1e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Volume volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 (35fc4155-3ccf-4128-8d5e-0a64797e2265): created successfully Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f75404-f5d7-4863-97cc-3744fdc1e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (71c4923e-ce61-430e-b20d-d5e708277b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-f0af1ad1-851a-46fa-b17f-2555116906ba tempest-ServerActionsTestOtherA-721427442 None] Terminate volume connection completed successfully. Sep 01 00:21:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-f0af1ad1-851a-46fa-b17f-2555116906ba tempest-ServerActionsTestOtherA-721427442 None] Deleting attachment d6ff81b2-0cd9-4adf-85c4-316e26e01330. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:21:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3e47abad-a4f3-4db6-aae4-76279aaf97b7 tempest-AttachVolumeTestJSON-2070579472 None] Created volume successfully. Sep 01 00:21:42 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:42 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "cinder-e7508bb0-c282-41f7-a5f2-99434202dbe1-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-e7508bb0-c282-41f7-a5f2-99434202dbe1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "cinder-quobyte-e7508bb0-c282-41f7-a5f2-99434202dbe1" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-quobyte-e7508bb0-c282-41f7-a5f2-99434202dbe1" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4784c3e-a1ca-4212-b519-3cf33a26f76d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:43 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.430s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2003a444-b07c-4e00-9623-f6887b355c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eee2d4-c8d4-43dd-ad3c-1ef69dda1210]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:43 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 Sep 01 00:21:43 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:43 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:43 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:43 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1" returned: 0 in 0.520s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:43 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1 Sep 01 00:21:43 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:44 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.763s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:44 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e7508bb0-c282-41f7-a5f2-99434202dbe1" returned: 0 in 0.334s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-quobyte-e7508bb0-c282-41f7-a5f2-99434202dbe1" released by "delete_volume" :: held 0.925s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:44 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:44 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.quota [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Created reservations ['db7f232d-642c-4792-8b9b-89a89e65d662', '2fdbc3f1-b859-4d0e-8186-c06baa575cde', '85fec2a5-e423-4122-9388-35ab5a055e90', '05cdea31-d7e9-4592-a9b1-92ca6d38701a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-06864e8f-4b76-4389-aa2e-b6c9587f2cd9 req-275f441d-b324-4511-b881-5e03a419c040 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-06864e8f-4b76-4389-aa2e-b6c9587f2cd9 req-275f441d-b324-4511-b881-5e03a419c040 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:44 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:44 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-06864e8f-4b76-4389-aa2e-b6c9587f2cd9 req-275f441d-b324-4511-b881-5e03a419c040 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Created reservations ['9d33978f-5121-441b-9cac-c1686037935a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-06864e8f-4b76-4389-aa2e-b6c9587f2cd9 req-275f441d-b324-4511-b881-5e03a419c040 tempest-AttachVolumeTestJSON-2070579472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-35fc4155-3ccf-4128-8d5e-0a64797e2265', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '438bfe21-1b95-4607-94d3-12c51dfbc919', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:21:44 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.436s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:44 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04 Sep 01 00:21:44 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:44 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:44 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-06864e8f-4b76-4389-aa2e-b6c9587f2cd9 req-275f441d-b324-4511-b881-5e03a419c040 tempest-AttachVolumeTestJSON-2070579472 None] attachment_update completed successfully. Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "cinder-d26a52ee-222e-48dc-b731-c4b428fa9e43-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-d26a52ee-222e-48dc-b731-c4b428fa9e43-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "cinder-quobyte-d26a52ee-222e-48dc-b731-c4b428fa9e43" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-quobyte-d26a52ee-222e-48dc-b731-c4b428fa9e43" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:44 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.445s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG cinder.manager [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Deleted volume successfully. Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b8df28-edb4-4bcb-84ab-5673143ed00b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:44 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06.bb2952e2-1a06-4552-a4b8-29fc652bcf04" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-756d4ff8-e9a0-4ae9-89b1-c707fca536f2 req-50d3dc91-91cb-4e2c-8257-5bd7dd9cfb50 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-e7508bb0-c282-41f7-a5f2-99434202dbe1-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-bb2952e2-1a06-4552-a4b8-29fc652bcf04" released by "_delete_snapshot" :: held 2.191s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" released by "delete_snapshot" :: held 2.224s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:45 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.424s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5777f284-9162-4912-b0ed-e64ed8105d7f tempest-GroupsV320Test-115766598 None] Delete group completed successfully. Sep 01 00:21:45 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 Sep 01 00:21:45 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['902614c7-8b1d-4cc4-a16f-d86106650ae2', '1b57cc14-9cb3-4e2c-a249-b98e420684a7', '81dd088a-e818-4432-9e52-9581767b44bd', '64a743eb-5386-4277-9160-a266cceb9f18'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Delete snapshot completed successfully. Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-bb2952e2-1a06-4552-a4b8-29fc652bcf04-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Snapshots deleted, issuing volume delete {{(pid=87803) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be566f3-65eb-4016-8bb0-f8cbef90f052]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:45 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:45 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:45 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43" returned: 0 in 0.505s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:45 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43 Sep 01 00:21:45 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:45 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.473s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:45 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06 Sep 01 00:21:45 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:45 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d26a52ee-222e-48dc-b731-c4b428fa9e43" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-quobyte-d26a52ee-222e-48dc-b731-c4b428fa9e43" released by "delete_volume" :: held 0.930s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Created reservations ['694796dc-c5c8-4059-b26f-cd2a56af90b7', '0cc1e3db-d5a7-4be1-94b8-da6af49f3559', '72a5403c-8a7b-42c2-bc6a-063789a1692c', '6b3bca08-5ae8-4a9a-9e7f-8979147b2b64'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:45 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:45 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:46 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2003a444-b07c-4e00-9623-f6887b355c06" returned: 0 in 0.310s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-2003a444-b07c-4e00-9623-f6887b355c06" released by "delete_volume" :: held 0.845s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['355a95ad-af65-4302-a0de-f31979f521b4', '8749240e-a31d-4281-9531-231d90106130', 'f0ef17ac-2252-474e-9d50-2d3769e2b384', 'e3dbfed6-241c-40a5-8b59-74fd942d21b9'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:46 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:46 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:46 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Deleted volume successfully. Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-71adaebb-3cd4-4bf7-a1e6-e8932deeb225 tempest-ServerActionsTestOtherA-721427442 None] Lock "cinder-d26a52ee-222e-48dc-b731-c4b428fa9e43-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:46 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.305s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Deleted volume successfully. Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e58e5bd1-6c7b-4573-b37b-bc7c6cab33c6 tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-2003a444-b07c-4e00-9623-f6887b355c06-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (86b11402-cd02-41da-bd27-bcade5da4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca22e8-f59b-4386-b6cc-0ba6d91ba54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ca22e8-f59b-4386-b6cc-0ba6d91ba54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1415901892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:47Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbf959b-0ec2-4fae-a506-45f3585685a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbf959b-0ec2-4fae-a506-45f3585685a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b660d49-1e38-48c1-88e2-52df0fae636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b660d49-1e38-48c1-88e2-52df0fae636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4', 'volume_name': 'volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914c3cab-dd99-4e17-9591-152b6ce3570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914c3cab-dd99-4e17-9591-152b6ce3570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a83d6-fb45-4a2e-83cf-bda62921351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Volume 3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4', 'volume_size': 1} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1415901892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c0710b10c84826a95ee76142d71b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:47Z,use_quota=True,user_id='032e2b99a4754199b3c79f435c94ec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Creating volume 3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:47 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:47 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 1073741824 Sep 01 00:21:47 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-0f31e524-8684-4257-a2ce-e0db3b4a8477-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-0f31e524-8684-4257-a2ce-e0db3b4a8477-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebaedff-e9eb-462e-8301-be5ac61627aa]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:47 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 Sep 01 00:21:47 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:47 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 1073741824" returned: 0 in 0.787s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:47 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 Sep 01 00:21:47 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:48 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477" returned: 0 in 0.743s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:48 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:48 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477 Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:48 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0a83d6-fb45-4a2e-83cf-bda62921351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14992d5-8dea-468c-a8d1-2f210c928573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:48 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Volume volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 (3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4): created successfully Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14992d5-8dea-468c-a8d1-2f210c928573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Flow 'volume_create_manager' (86b11402-cd02-41da-bd27-bcade5da4919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-87145a9d-330f-4b5f-8e02-fec40a759755 tempest-AttachVolumeTestJSON-2070579472 None] Created volume successfully. Sep 01 00:21:48 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f31e524-8684-4257-a2ce-e0db3b4a8477" returned: 0 in 0.486s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-quobyte-0f31e524-8684-4257-a2ce-e0db3b4a8477" released by "delete_volume" :: held 1.295s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Created reservations ['c3216e9d-d02d-4750-912d-84a084bb6237', '3acf9b3d-7af7-41d6-b068-e668021a429f', '202900ea-6b09-4485-82d9-ac6af9302972', 'a31966cc-c7f5-4a2d-8686-01b025deba69'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:48 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:21:48 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:49 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:49 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:21:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Deleted volume successfully. Sep 01 00:21:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-87696c4a-c0a7-4854-89d4-20488f42acda tempest-VolumesDeleteCascade-1219196199 None] Lock "cinder-0f31e524-8684-4257-a2ce-e0db3b4a8477-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:21:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-b7f63341-77ce-4550-9c0d-d4506218a9f3 req-0e186a7f-6ba7-45a0-8b84-3a7c7eeed5eb tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-b7f63341-77ce-4550-9c0d-d4506218a9f3 req-0e186a7f-6ba7-45a0-8b84-3a7c7eeed5eb tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-b7f63341-77ce-4550-9c0d-d4506218a9f3 req-0e186a7f-6ba7-45a0-8b84-3a7c7eeed5eb tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-b7f63341-77ce-4550-9c0d-d4506218a9f3 req-0e186a7f-6ba7-45a0-8b84-3a7c7eeed5eb tempest-AttachVolumeTestJSON-2070579472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fff2effb-0e30-4ca1-b913-7b23ca836778', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:21:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-b7f63341-77ce-4550-9c0d-d4506218a9f3 req-0e186a7f-6ba7-45a0-8b84-3a7c7eeed5eb tempest-AttachVolumeTestJSON-2070579472 None] attachment_update completed successfully. Sep 01 00:21:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-bf0c1371-56aa-440e-9bab-83a13b0fa98d req-a8a467e6-91be-43e5-82b4-262e1c7d91f6 tempest-AttachVolumeTestJSON-2070579472 None] Terminate volume connection completed successfully. Sep 01 00:21:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-bf0c1371-56aa-440e-9bab-83a13b0fa98d req-a8a467e6-91be-43e5-82b4-262e1c7d91f6 tempest-AttachVolumeTestJSON-2070579472 None] Deleting attachment 438bfe21-1b95-4607-94d3-12c51dfbc919. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:21:53 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-94b4796c-4132-40a4-aff1-ead7a1be2616 req-06a1e213-994c-44b2-a5e1-d3cbc4825c13 tempest-AttachVolumeTestJSON-2070579472 None] Terminate volume connection completed successfully. Sep 01 00:21:53 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-94b4796c-4132-40a4-aff1-ead7a1be2616 req-06a1e213-994c-44b2-a5e1-d3cbc4825c13 tempest-AttachVolumeTestJSON-2070579472 None] Deleting attachment fff2effb-0e30-4ca1-b913-7b23ca836778. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (24d43193-00d2-4846-baa9-685afb35618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd39b6b6-8c7f-4ef1-bf64-0ae039db3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd39b6b6-8c7f-4ef1-bf64-0ae039db3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1553720809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dee02a-6b59-4228-99a7-ee6c5668839c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:55Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeca56-3ace-4e4d-b223-e6b62e9e100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeca56-3ace-4e4d-b223-e6b62e9e100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac4042-6337-4115-8fa3-753da24deab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac4042-6337-4115-8fa3-753da24deab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85dee02a-6b59-4228-99a7-ee6c5668839c', 'volume_name': 'volume-85dee02a-6b59-4228-99a7-ee6c5668839c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f0a5ef-c943-4328-9cd8-ae88353f6716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f0a5ef-c943-4328-9cd8-ae88353f6716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2de41b-d1ed-4fd6-b7c6-3fcc5d2afe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Volume 85dee02a-6b59-4228-99a7-ee6c5668839c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85dee02a-6b59-4228-99a7-ee6c5668839c', 'volume_size': 1} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1553720809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dee02a-6b59-4228-99a7-ee6c5668839c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:55Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Creating volume 85dee02a-6b59-4228-99a7-ee6c5668839c {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:54 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c 1073741824 Sep 01 00:21:54 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:55 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c 1073741824" returned: 0 in 0.665s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:55 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c Sep 01 00:21:55 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:55 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2de41b-d1ed-4fd6-b7c6-3fcc5d2afe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dee02a-6b59-4228-99a7-ee6c5668839c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7db31a-51b8-4b53-96ac-1c86c3e4524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Volume volume-85dee02a-6b59-4228-99a7-ee6c5668839c (85dee02a-6b59-4228-99a7-ee6c5668839c): created successfully Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7db31a-51b8-4b53-96ac-1c86c3e4524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (24d43193-00d2-4846-baa9-685afb35618c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fb23a8ff-9b0d-4046-983d-363d09318b92 tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (f6d63071-0d25-4f90-a2ff-27f2f8054ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2b3c07-8858-4392-b0e6-1d09ed76a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2b3c07-8858-4392-b0e6-1d09ed76a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314416184',display_name='tempest-VolumesGetTest-Volume-13961374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3095073-807f-4437-9977-1da68e514ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:58Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99132b42-eb50-4fa1-8387-c93857845483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99132b42-eb50-4fa1-8387-c93857845483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54da26b-5ec2-4ddf-9c50-1710d9824b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54da26b-5ec2-4ddf-9c50-1710d9824b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3095073-807f-4437-9977-1da68e514ac3', 'volume_name': 'volume-d3095073-807f-4437-9977-1da68e514ac3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6148b44-1567-43e7-b826-69bbdde1e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6148b44-1567-43e7-b826-69bbdde1e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b82bf8-4511-4c02-a77b-d526f8cfb1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Volume d3095073-807f-4437-9977-1da68e514ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3095073-807f-4437-9977-1da68e514ac3', 'volume_size': 1} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:21:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-314416184',display_name='tempest-VolumesGetTest-Volume-13961374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3095073-807f-4437-9977-1da68e514ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:21:58Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Creating volume d3095073-807f-4437-9977-1da68e514ac3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:21:57 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:21:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:57 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 1073741824 Sep 01 00:21:57 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:58 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 1073741824" returned: 0 in 0.752s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:21:58 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 Sep 01 00:21:58 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:21:58 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3" returned: 0 in 0.327s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b82bf8-4511-4c02-a77b-d526f8cfb1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3095073-807f-4437-9977-1da68e514ac3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5984259-c85b-4111-acc7-f11216a36346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:21:58 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Volume volume-d3095073-807f-4437-9977-1da68e514ac3 (d3095073-807f-4437-9977-1da68e514ac3): created successfully Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5984259-c85b-4111-acc7-f11216a36346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:21:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (f6d63071-0d25-4f90-a2ff-27f2f8054ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:21:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-12857a42-dd6d-408d-bbbb-07de5d54600b tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:21:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-d3095073-807f-4437-9977-1da68e514ac3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "cinder-d3095073-807f-4437-9977-1da68e514ac3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:21:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-d3095073-807f-4437-9977-1da68e514ac3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:21:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-d3095073-807f-4437-9977-1da68e514ac3" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc25f7-ce83-457c-8391-a9af052c86bd]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:00 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 Sep 01 00:22:00 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-quobyte-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ad3ce-d5c9-4d32-ae37-3d0662837358]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:00 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 Sep 01 00:22:00 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:00 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:00 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3 Sep 01 00:22:00 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:00 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" returned: 0 in 0.443s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:00 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4 Sep 01 00:22:00 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:00 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d3095073-807f-4437-9977-1da68e514ac3" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-d3095073-807f-4437-9977-1da68e514ac3" released by "delete_volume" :: held 0.844s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Created reservations ['ba95998c-9f92-44bf-a224-ec9872b9d85c', '9cee84ba-ee1a-4b91-bb05-8237d5ff2d01', '979be6e1-23ca-40bb-9607-220a45fc1c00', '295163dd-dbcd-41a2-8916-c340066b5427'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:01 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:01 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:01 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" returned: 0 in 0.308s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4" released by "delete_volume" :: held 0.819s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Created reservations ['6af80b57-1bf6-47b0-bb6d-f6e4e16a6070', '8b7033e2-a84b-40f3-a34c-209af2f84a04', '2eddecda-d203-4d35-9888-6b3afd982109', 'dbec72d1-88d9-43f8-888f-a7216f6cb194'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-85dee02a-6b59-4228-99a7-ee6c5668839c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "cinder-85dee02a-6b59-4228-99a7-ee6c5668839c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:01 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.427s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:01 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-85dee02a-6b59-4228-99a7-ee6c5668839c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:01 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-35fc4155-3ccf-4128-8d5e-0a64797e2265-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-85dee02a-6b59-4228-99a7-ee6c5668839c" acquired by "delete_volume" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9e72f514-00c0-4dec-8002-15b8912c840c tempest-VolumesGetTest-1872390408 None] Lock "cinder-d3095073-807f-4437-9977-1da68e514ac3-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0b96d-472e-4342-951a-716986b5e08f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-35fc4155-3ccf-4128-8d5e-0a64797e2265-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-quobyte-35fc4155-3ccf-4128-8d5e-0a64797e2265" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-35fc4155-3ccf-4128-8d5e-0a64797e2265" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b07a9-8986-4f23-bc27-8ec08c65c6e4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:01 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c Sep 01 00:22:01 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:01 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:01 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 Sep 01 00:22:01 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.411s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Deleted volume successfully. Sep 01 00:22:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3deacb3f-7c8a-4e47-aa86-4988612ef434 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-3a3bdf82-be2c-4aa9-8543-bdcc6c18c0c4-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:02 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c" returned: 0 in 0.561s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:02 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c Sep 01 00:22:02 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:02 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265" returned: 0 in 0.501s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:02 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265 Sep 01 00:22:02 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:02 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85dee02a-6b59-4228-99a7-ee6c5668839c" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-85dee02a-6b59-4228-99a7-ee6c5668839c" released by "delete_volume" :: held 0.952s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:02 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35fc4155-3ccf-4128-8d5e-0a64797e2265" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Created reservations ['83b09927-d2db-4eda-a9cf-e0e2c9fce730', '5ece2fce-d625-4787-b02f-c470105d220f', '5a1af10a-815b-46cc-945b-dd0ddb93f8a6', '651465c5-249e-439e-af8b-6b7765b093d4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-35fc4155-3ccf-4128-8d5e-0a64797e2265" released by "delete_volume" :: held 0.916s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Created reservations ['0dea2c23-2e46-4ee5-9129-fa69b40c5cc0', '80a28969-86d1-49e8-bbc0-8fc03f0f410a', 'd4470d20-ae0c-4483-b8e8-71b65277970c', '86e49a45-45d2-4a50-a605-2286805c33b0'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:02 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:02 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:02 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:02 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:02 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.344s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:02 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:02 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Flow 'volume_create_manager' (0a2daadc-5857-413e-919c-bd51af33558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a790eb15-a8e9-4040-8d6c-63a5b81ff653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a790eb15-a8e9-4040-8d6c-63a5b81ff653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-856020318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc30dbd-634a-4b7d-85a6-75ec3a96e976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4775b7b0fe2d4ca4b4589aeddbaaa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:03Z,use_quota=True,user_id='92d4c65d92314cbfa01f24c3a48dfa6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338af0c0-f00b-4950-a071-2c20f417bc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338af0c0-f00b-4950-a071-2c20f417bc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1478e83d-2641-4950-9d76-310163e6f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1478e83d-2641-4950-9d76-310163e6f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc30dbd-634a-4b7d-85a6-75ec3a96e976', 'volume_name': 'volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:03 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d2c510-1638-46c9-8820-41cfb5546291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d2c510-1638-46c9-8820-41cfb5546291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d011d27d-aeec-4606-b316-369cf03b7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:03 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976', 'volume_size': 1} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-856020318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc30dbd-634a-4b7d-85a6-75ec3a96e976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4775b7b0fe2d4ca4b4589aeddbaaa2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:03Z,use_quota=True,user_id='92d4c65d92314cbfa01f24c3a48dfa6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Creating volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:03 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cc4eb12e-7d89-45a8-a6fc-9e1b6146420f tempest-VolumesGetTest-1872390408 None] Lock "cinder-85dee02a-6b59-4228-99a7-ee6c5668839c-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Deleted volume successfully. Sep 01 00:22:03 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 1073741824 Sep 01 00:22:03 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-69486cee-1231-4886-8cc6-b0a0d3e1eefa tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-35fc4155-3ccf-4128-8d5e-0a64797e2265-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:03 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 1073741824" returned: 0 in 0.454s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:03 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 Sep 01 00:22:03 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-456536fb-8467-4533-874f-b8ce105ce128-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-456536fb-8467-4533-874f-b8ce105ce128-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:03 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "cinder-quobyte-456536fb-8467-4533-874f-b8ce105ce128" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d011d27d-aeec-4606-b316-369cf03b7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ed83f4-4670-48c4-8483-414c69598800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-456536fb-8467-4533-874f-b8ce105ce128" acquired by "delete_volume" :: waited 0.044s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Volume volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 (dcc30dbd-634a-4b7d-85a6-75ec3a96e976): created successfully Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ed83f4-4670-48c4-8483-414c69598800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Flow 'volume_create_manager' (0a2daadc-5857-413e-919c-bd51af33558d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374383d-9c4b-4bb3-a318-410face692a6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:04 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1010a53a-ce12-420c-8960-933b7af23c54 tempest-SnapshotsActionsTest-2058077818 None] Created volume successfully. Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (7fad8f9e-c12d-4348-9a2e-ad5280733462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bcebc4-a462-4cd3-b61c-e274e8cd724a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 Sep 01 00:22:04 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bcebc4-a462-4cd3-b61c-e274e8cd724a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173285193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf3bdc6-471c-4135-a0e1-e14e930838ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:04Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090411a-5ee1-4e14-812c-aeaa40a8cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b090411a-5ee1-4e14-812c-aeaa40a8cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34130e-ddea-4c12-a5ae-e91f155e1877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34130e-ddea-4c12-a5ae-e91f155e1877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'volume_name': 'volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20567582-ea79-4ace-93a5-799be02615e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20567582-ea79-4ace-93a5-799be02615e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afa17b-c004-4bba-b4dc-8e98d411c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Volume 4cf3bdc6-471c-4135-a0e1-e14e930838ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'volume_size': 1} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173285193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf3bdc6-471c-4135-a0e1-e14e930838ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:04Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Creating volume 4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:04 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:04 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff 1073741824 Sep 01 00:22:04 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:04 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128" returned: 0 in 0.401s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:04 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128 Sep 01 00:22:04 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:04 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff 1073741824" returned: 0 in 0.476s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:04 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=142,cinder:UPDATE=159,cinder:DELETE=9,cinder:INSERT=35 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=141,cinder:UPDATE=144,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-456536fb-8467-4533-874f-b8ce105ce128" returned: 0 in 0.283s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-quobyte-456536fb-8467-4533-874f-b8ce105ce128" released by "delete_volume" :: held 0.756s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:04 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:04 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Created reservations ['272468fa-4025-4725-a776-e3558597d1ca', 'd35476c8-6d42-4176-8619-5aa08ca9e9ad', 'd1a93e11-b2fb-4822-abe0-020298466ba6', '339af948-eb32-47fc-b1f7-b3b49990e210'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:05 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:05 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:05 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.374s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3afa17b-c004-4bba-b4dc-8e98d411c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf941a9-80dc-4a36-ba44-a8ffc9ec0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Volume volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff (4cf3bdc6-471c-4135-a0e1-e14e930838ff): created successfully Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf941a9-80dc-4a36-ba44-a8ffc9ec0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (7fad8f9e-c12d-4348-9a2e-ad5280733462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5f03f881-9555-41f9-9e7c-ad5e96675a86 tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:05 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.507s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Creating offline snapshot 78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Deleted volume successfully. Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8630058a-b80b-4c69-9797-2d8aed001905]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22a3cc75-4bee-44e9-ba72-34878975fb94 tempest-AttachVolumeTestJSON-2070579472 None] Lock "cinder-456536fb-8467-4533-874f-b8ce105ce128-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:05 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 Sep 01 00:22:05 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:05 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:05 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d 1G Sep 01 00:22:05 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:06 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d 1G" returned: 0 in 0.505s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:06 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:06 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:06 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:06 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.486s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:06 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d is being set with open permissions: ugo+rw Sep 01 00:22:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:06 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (09b8e3d8-511d-4d33-a4d7-8a5baa966798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:07 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4086f32-a500-4bdb-be18-a62ad3677502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4086f32-a500-4bdb-be18-a62ad3677502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1722369045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7fc62b-ede2-4a42-aab8-aac43fccc2fc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4cf3bdc6-471c-4135-a0e1-e14e930838ff,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:07Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63a0c5e-2747-4782-a044-021086c129d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63a0c5e-2747-4782-a044-021086c129d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc33de2-2d5a-4c86-aad7-2e9e1f5c0bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc33de2-2d5a-4c86-aad7-2e9e1f5c0bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d7fc62b-ede2-4a42-aab8-aac43fccc2fc', 'volume_name': 'volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc', 'volume_size': 1, 'source_volid': '4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'source_volstatus': 'available'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8d5d88-ac16-45ae-9b03-e5fc9aba8642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8d5d88-ac16-45ae-9b03-e5fc9aba8642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e855be92-e845-44d9-bfff-04de7dc0563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Volume 5d7fc62b-ede2-4a42-aab8-aac43fccc2fc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc', 'volume_size': 1, 'source_volid': '4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'source_volstatus': 'available'} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:07 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:07 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info Sep 01 00:22:07 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:07 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info" returned: 0 in 0.293s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:07 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info is being set with open permissions: ugo+rw Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:07 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info Sep 01 00:22:07 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:07 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.info" returned: 0 in 0.280s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.828s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:07 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Cloning volume 4cf3bdc6-471c-4135-a0e1-e14e930838ff to volume 5d7fc62b-ede2-4a42-aab8-aac43fccc2fc Sep 01 00:22:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-706e9ee0-5dca-40a7-9bfb-cf3b4fddc88b tempest-SnapshotsActionsTest-2058077818 None] Create snapshot completed successfully Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Creating offline snapshot e7f6607c-b3f4-48d2-aae6-8f240532ac4f of volume 4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3320008a-6495-4650-8088-8dba45e6164a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:08 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:08 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:08 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:08 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f 1G Sep 01 00:22:08 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:08 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f 1G" returned: 0 in 0.509s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:09 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:09 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:09 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.456s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:09 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f is being set with open permissions: ugo+rw Sep 01 00:22:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:09 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:09 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:09 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:09 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info Sep 01 00:22:09 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:10 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:10 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info is being set with open permissions: ugo+rw Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:10 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info Sep 01 00:22:10 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:10 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.info" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] snapshot: e7f6607c-b3f4-48d2-aae6-8f240532ac4f, volume: 5d7fc62b-ede2-4a42-aab8-aac43fccc2fc, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7451d85-46c3-4a2a-93cf-0b86580cc97e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:10 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:10 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:11 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.561s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed252e89-1b73-42e9-a74a-3e6f01c02021]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:11 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:11 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:11 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.398s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:22:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:11 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc Sep 01 00:22:11 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:13 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:13 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:14 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.457s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:22:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:22:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" returned: 0 in 6.057s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:22:17 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Converted 1024.00 MB image at 169.00 MB/s Sep 01 00:22:17 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc is being set with open permissions: ugo+rw Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:17 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc Sep 01 00:22:17 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Flow 'volume_create_manager' (4657a0ba-efc3-4002-abd4-01b2478a5678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e0028-f073-4eb0-b5d7-2c501ff8ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e0028-f073-4eb0-b5d7-2c501ff8ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1770310082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546cc4f9-cce0-4268-997b-351b6cf60684,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0641881d8e294819ac313bafd7dd6507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:18Z,use_quota=True,user_id='9b87c33cffe84d0198ed99b63a20518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d26f4c-e881-4d90-8707-d6e096d3b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d26f4c-e881-4d90-8707-d6e096d3b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e13184-568e-4615-b42b-b8f7bef2b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e13184-568e-4615-b42b-b8f7bef2b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546cc4f9-cce0-4268-997b-351b6cf60684', 'volume_name': 'volume-546cc4f9-cce0-4268-997b-351b6cf60684', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309aa97b-f726-499b-a828-94bc8e709202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309aa97b-f726-499b-a828-94bc8e709202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d04af7-696a-49ba-807f-0b8bb7c046b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:17 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Volume 546cc4f9-cce0-4268-997b-351b6cf60684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546cc4f9-cce0-4268-997b-351b6cf60684', 'volume_size': 1} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:17 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" released by "_copy_volume_from_snapshot" :: held 7.359s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-e7f6607c-b3f4-48d2-aae6-8f240532ac4f" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-e7f6607c-b3f4-48d2-aae6-8f240532ac4f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Deleting offline snapshot e7f6607c-b3f4-48d2-aae6-8f240532ac4f of volume 4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] snapshot_file for this snap is: volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc04b56-6f2d-4100-b36c-0f46a10d72e5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:17 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:17 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:18 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.378s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893de8d-33dd-4312-a922-d2ed37cef093]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:18 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:18 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:18 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.564s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:18 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:18 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:19 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.360s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:19 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f Sep 01 00:22:19 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:19 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff.e7f6607c-b3f4-48d2-aae6-8f240532ac4f" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-e7f6607c-b3f4-48d2-aae6-8f240532ac4f" released by "_delete_snapshot" :: held 1.637s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.562s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.274s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e855be92-e845-44d9-bfff-04de7dc0563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc', 'volume_size': 1, 'source_volid': '4cf3bdc6-471c-4135-a0e1-e14e930838ff', 'source_volstatus': 'available'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7060a1fc-5964-41fc-8217-e862f78790a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Creating offline snapshot a679d944-faaf-44db-98c8-751698b14704 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Volume volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc (5d7fc62b-ede2-4a42-aab8-aac43fccc2fc): created successfully Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7060a1fc-5964-41fc-8217-e862f78790a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (09b8e3d8-511d-4d33-a4d7-8a5baa966798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22be28e-c595-448b-8348-cd5b41f6efec]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2034db93-942b-4225-8278-467d81fd01df tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:22:19 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:19 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:19 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:19 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 1G Sep 01 00:22:19 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:20 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 1G" returned: 0 in 0.500s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:20 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 Sep 01 00:22:20 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:20 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704" returned: 0 in 0.349s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:20 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 is being set with open permissions: ugo+rw Sep 01 00:22:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:20 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 Sep 01 00:22:20 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (4652bcee-c6c4-4095-827e-c2226d840983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63033a3f-5e8d-4a6c-84d0-9462206d6dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:21 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704" returned: 0 in 0.327s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63033a3f-5e8d-4a6c-84d0-9462206d6dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-92999262',display_name='tempest-VolumesGetTest-Volume-878552117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:21Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2b9a2a-79ab-4901-8f3c-1286dc9a19ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2b9a2a-79ab-4901-8f3c-1286dc9a19ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55d2c4-6640-4b67-b58e-3119f0961394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce55d2c4-6640-4b67-b58e-3119f0961394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d', 'volume_name': 'volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deeaee8-e481-4b0a-95e8-98670fcda268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1deeaee8-e481-4b0a-95e8-98670fcda268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f74ff80-3a1b-440f-a79c-dc65d0656d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Volume 3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d', 'volume_size': 1} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.713s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1770310082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546cc4f9-cce0-4268-997b-351b6cf60684,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0641881d8e294819ac313bafd7dd6507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:18Z,use_quota=True,user_id='9b87c33cffe84d0198ed99b63a20518b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Creating volume 546cc4f9-cce0-4268-997b-351b6cf60684 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:21 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:21 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 1073741824 Sep 01 00:22:21 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7cadd072-20dd-48fd-a2b8-647e1f36adaf tempest-SnapshotsActionsTest-2058077818 None] Create snapshot completed successfully Sep 01 00:22:21 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 1073741824" returned: 0 in 0.510s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:21 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 Sep 01 00:22:21 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-a679d944-faaf-44db-98c8-751698b14704-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-a679d944-faaf-44db-98c8-751698b14704-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:22 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-92999262',display_name='tempest-VolumesGetTest-Volume-878552117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:21Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Creating volume 3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:22 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-a679d944-faaf-44db-98c8-751698b14704" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d04af7-696a-49ba-807f-0b8bb7c046b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546cc4f9-cce0-4268-997b-351b6cf60684', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:22 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d 1073741824 Sep 01 00:22:22 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b016d18-8d7d-49bd-8451-cecb2f074b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-a679d944-faaf-44db-98c8-751698b14704" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Deleting offline snapshot a679d944-faaf-44db-98c8-751698b14704 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] snapshot_file for this snap is: volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Volume volume-546cc4f9-cce0-4268-997b-351b6cf60684 (546cc4f9-cce0-4268-997b-351b6cf60684): created successfully Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b016d18-8d7d-49bd-8451-cecb2f074b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Flow 'volume_create_manager' (4657a0ba-efc3-4002-abd4-01b2478a5678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596c061-c76f-4283-9ac7-f1361116eea4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-ef53d99a-47ae-4ab9-a02d-b47e82df7e9f req-24d599dd-c7f7-4ebc-ae8a-e382c6bc573d tempest-VolumesGetTestJSON-61456162 None] Created volume successfully. Sep 01 00:22:22 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 Sep 01 00:22:22 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:22 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d 1073741824" returned: 0 in 0.617s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:22 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704" returned: 0 in 0.532s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f197be7-9177-4b45-a96c-698279676337]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:22 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d Sep 01 00:22:22 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:23 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:23 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:23 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" returned: 0 in 0.282s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f74ff80-3a1b-440f-a79c-dc65d0656d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9d8825-4b1b-4611-b66e-c722057d7480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:23 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Volume volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d (3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d): created successfully Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9d8825-4b1b-4611-b66e-c722057d7480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (4652bcee-c6c4-4095-827e-c2226d840983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f99eb59d-e848-45b7-a47c-d7c0841834cf tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:22:23 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.448s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:23 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 Sep 01 00:22:23 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Acquiring lock "cinder-546cc4f9-cce0-4268-997b-351b6cf60684-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "cinder-546cc4f9-cce0-4268-997b-351b6cf60684-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Acquiring lock "cinder-quobyte-546cc4f9-cce0-4268-997b-351b6cf60684" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "cinder-quobyte-546cc4f9-cce0-4268-997b-351b6cf60684" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba034d69-5564-4a6b-b7fb-dfd58023e103]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:23 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 Sep 01 00:22:23 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:23 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:23 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704 Sep 01 00:22:23 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:24 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684" returned: 0 in 0.445s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:24 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684 Sep 01 00:22:24 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:24 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.a679d944-faaf-44db-98c8-751698b14704" returned: 0 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-a679d944-faaf-44db-98c8-751698b14704" released by "_delete_snapshot" :: held 1.955s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_snapshot" :: held 2.000s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Created reservations ['61e2b4d6-8817-442a-b99a-874153d9d8ab', '2dc8b611-eb05-45cc-964d-5b1e96ca3cfa', 'b6bc948b-dd3d-4b12-aed0-9fbecf1ecc50', 'e84f1d61-cf84-4b8c-90c9-4122a6a5f268'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Delete snapshot completed successfully. Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6441b483-46eb-47de-84a8-e75e3df851de tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-a679d944-faaf-44db-98c8-751698b14704-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:24 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-546cc4f9-cce0-4268-997b-351b6cf60684" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "cinder-quobyte-546cc4f9-cce0-4268-997b-351b6cf60684" released by "delete_volume" :: held 0.859s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.quota [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Created reservations ['3bc4036a-9785-4168-9917-f2a148c260bf', '1ac0aa3a-744e-4e8c-9469-256b4fefc20e', 'a85295e9-dd0e-4fb6-89e7-304b4c18a0a2', '281dc87b-624c-4c30-bdd0-dd519cf5847f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "cinder-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[45612da4-298d-4779-9590-35ce87471591]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:24 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:24 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:24 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d Sep 01 00:22:24 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:25 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.477s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:25 devstack cinder-volume[87803]: DEBUG cinder.manager [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Deleted volume successfully. Sep 01 00:22:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-f1eec5e5-ff13-4a9b-a8d2-9f9af5335508 req-bf27cdfd-7448-4ca0-902d-6e2b8b83f476 tempest-VolumesGetTestJSON-61456162 None] Lock "cinder-546cc4f9-cce0-4268-997b-351b6cf60684-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:25 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" returned: 0 in 1.132s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:25 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d Sep 01 00:22:25 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Creating offline snapshot 7b07d248-1557-4b18-ae60-125036e7a7bb of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:26 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" returned: 0 in 0.534s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d" released by "delete_volume" :: held 1.743s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ee40a-244b-4515-9aba-914fa5b5a64f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Created reservations ['081e5a5a-578a-44d6-aa63-b98277a8ebd1', 'f708a2d4-ecc4-4a88-bc36-92906b370aed', '87ba67bf-39e4-4a31-a777-d76e7fe6824e', 'a3ff5270-882a-4488-8c7e-0d9f1375c277'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:26 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:26 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:26 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:26 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:27 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1470a56b-3ed1-4861-b9b5-8fb0de56f6e6 tempest-VolumesGetTest-1872390408 None] Lock "cinder-3e0f2aa9-0b98-4fce-9447-ad1c2eeb7f1d-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:27 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.795s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:27 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb 1G Sep 01 00:22:27 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" acquired by "delete_volume" :: waited 0.033s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e0765-b219-4630-9efb-913c14af40dd]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:27 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc Sep 01 00:22:27 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:27 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb 1G" returned: 0 in 0.728s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:27 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb Sep 01 00:22:27 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:28 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" returned: 0 in 0.697s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:28 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc Sep 01 00:22:28 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:28 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" returned: 0 in 0.408s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc" released by "delete_volume" :: held 1.183s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:28 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb" returned: 0 in 0.634s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:28 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb is being set with open permissions: ugo+rw Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:28 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb Sep 01 00:22:28 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Created reservations ['6595a022-8764-4725-8373-d241b8620ddd', 'a759a524-8769-49b1-b315-6aac675479a2', '5bdf309a-be05-41e6-995d-1034e9f173e6', 'e0eec6b2-c4c2-4fc6-a185-dd81b30c83dc'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:28 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:28 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:28 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb" returned: 0 in 0.414s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-30f112c1-2c08-4588-8bf0-5bc86d67f134 tempest-SnapshotsActionsTest-2058077818 None] Create snapshot completed successfully Sep 01 00:22:29 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.502s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8761d3ce-a910-4b47-99f2-40b145bc8ca0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-5d7fc62b-ede2-4a42-aab8-aac43fccc2fc-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-7b07d248-1557-4b18-ae60-125036e7a7bb-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-4cf3bdc6-471c-4135-a0e1-e14e930838ff-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-7b07d248-1557-4b18-ae60-125036e7a7bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "cinder-4cf3bdc6-471c-4135-a0e1-e14e930838ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-7b07d248-1557-4b18-ae60-125036e7a7bb" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-7b07d248-1557-4b18-ae60-125036e7a7bb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Deleting offline snapshot 7b07d248-1557-4b18-ae60-125036e7a7bb of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] snapshot_file for this snap is: volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-4cf3bdc6-471c-4135-a0e1-e14e930838ff" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34903e-54eb-4eb6-bca6-556ce0f7c405]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-4cf3bdc6-471c-4135-a0e1-e14e930838ff" acquired by "delete_volume" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9b4ac-d35d-4079-a309-21794afec779]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:30 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb Sep 01 00:22:30 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:30 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:30 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:30 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb" returned: 0 in 0.619s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff788b75-e382-4c87-a08c-0af9ca24ec9d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:30 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.660s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:30 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:30 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:30 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff Sep 01 00:22:30 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:31 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.526s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:31 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb Sep 01 00:22:31 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:31 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4cf3bdc6-471c-4135-a0e1-e14e930838ff" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-4cf3bdc6-471c-4135-a0e1-e14e930838ff" released by "delete_volume" :: held 1.320s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Created reservations ['333b5221-f120-41d5-b69b-81f7fd193c3c', '99231548-9e20-473e-b3c5-89423fab7dfe', '4e6787b2-dac3-43e6-a466-f267bc38897f', 'a7007356-5b88-4f65-95c8-08331df1e93f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:31 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:31 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:31 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb" returned: 0 in 0.469s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:31 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb Sep 01 00:22:31 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:31 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.291s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-10924c18-1399-49b8-8bc8-90c20347b2db tempest-VolumesGetTest-1872390408 None] Lock "cinder-4cf3bdc6-471c-4135-a0e1-e14e930838ff-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:31 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.7b07d248-1557-4b18-ae60-125036e7a7bb" returned: 0 in 0.270s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-7b07d248-1557-4b18-ae60-125036e7a7bb" released by "_delete_snapshot" :: held 2.025s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_snapshot" :: held 2.073s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Created reservations ['1080d9ce-9db6-49cc-aced-84488abc4f05', '695cefe9-0319-437b-a5be-64e39878aaca', '65751ff4-d945-40f1-abf7-28128ec39868', '01448cea-649a-4587-89ce-01aef4cc91f2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Delete snapshot completed successfully. Sep 01 00:22:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8a2daa17-96d0-4f19-840f-ebd28bbd6244 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-7b07d248-1557-4b18-ae60-125036e7a7bb-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (4a144714-3d4f-4ab4-9913-f2733b86a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b4204a-a89c-41e2-871c-7babb4337024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b4204a-a89c-41e2-871c-7babb4337024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1226887863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffd7797-ac38-468f-8ad6-03b192775c04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:33Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060fbe17-5cd8-44da-9b4c-f7b0754c43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060fbe17-5cd8-44da-9b4c-f7b0754c43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20242bb2-9f7c-4c23-aefa-c099a445098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Creating offline snapshot c3cd3c5d-de41-4de6-be9a-071f541330d0 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c326b8a-2a3f-47c9-a184-84e566f5dfe9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20242bb2-9f7c-4c23-aefa-c099a445098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fffd7797-ac38-468f-8ad6-03b192775c04', 'volume_name': 'volume-fffd7797-ac38-468f-8ad6-03b192775c04', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082004c-d730-4169-835c-d8020b32c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082004c-d730-4169-835c-d8020b32c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce3a734-c242-4f3b-8349-39efb1e84a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Volume fffd7797-ac38-468f-8ad6-03b192775c04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fffd7797-ac38-468f-8ad6-03b192775c04', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 00:22:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Trying to clone fffd7797-ac38-468f-8ad6-03b192775c04 from image df40e229-b455-4243-a6fd-53ca30610169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:22:33 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:33 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:34 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:22:34 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Image download 20.69 MB at 20.69 MB/s Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.620s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:34 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 1G Sep 01 00:22:34 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad9fc4-ff3c-446b-ac21-fc26251e2cc2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:34 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD Sep 01 00:22:34 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:34 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 is fetched for user f2288e30c38845a884f3618f90d9cff6. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8094488-4ba4-43c1-b39f-b0450f9e61b1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:34 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 1G" returned: 0 in 0.672s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:34 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 Sep 01 00:22:34 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:34 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD Sep 01 00:22:34 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:35 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0" returned: 0 in 0.334s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:35 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 is being set with open permissions: ugo+rw Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:35 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:35 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 Sep 01 00:22:35 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:35 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0" returned: 0 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1226887863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffd7797-ac38-468f-8ad6-03b192775c04,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:33Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Creating volume fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:35 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1073741824 Sep 01 00:22:35 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9636760b-da97-406a-815c-b5254ef1aa99 tempest-SnapshotsActionsTest-2058077818 None] Create snapshot completed successfully Sep 01 00:22:35 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1073741824" returned: 0 in 0.468s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:35 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 Sep 01 00:22:35 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:36 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04" returned: 0 in 0.294s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Attempting download of df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume fffd7797-ac38-468f-8ad6-03b192775c04. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25862f8-a936-4b0e-aff3-125cd8dbdaac]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:36 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41 Sep 01 00:22:36 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-c3cd3c5d-de41-4de6-be9a-071f541330d0-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-c3cd3c5d-de41-4de6-be9a-071f541330d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-c3cd3c5d-de41-4de6-be9a-071f541330d0" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-c3cd3c5d-de41-4de6-be9a-071f541330d0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Deleting offline snapshot c3cd3c5d-de41-4de6-be9a-071f541330d0 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] snapshot_file for this snap is: volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ab9c76-3137-40f8-babf-6e94679bc9a1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:36 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41" returned: 0 in 0.526s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:36 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 Sep 01 00:22:36 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:37 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41 Sep 01 00:22:37 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:37 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[91577329-858a-4b25-88ca-4f75b8bd5430]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:37 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41" returned: 1 in 0.472s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_d6wjrb41' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a13e042-375e-40c1-a393-8a029178d598]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:37 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:37 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:37 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD Sep 01 00:22:37 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:37 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] df40e229-b455-4243-a6fd-53ca30610169 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:22:37 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.506s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:37 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 Sep 01 00:22:37 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:37 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 Sep 01 00:22:37 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:38 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0" returned: 0 in 0.472s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:38 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0 Sep 01 00:22:38 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:38 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.c3cd3c5d-de41-4de6-be9a-071f541330d0" returned: 0 in 0.282s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-c3cd3c5d-de41-4de6-be9a-071f541330d0" released by "_delete_snapshot" :: held 1.818s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_snapshot" :: held 1.854s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Created reservations ['4b382458-b19b-4c95-922a-db98e3908d8b', '35dc706e-eefa-4a6a-9c20-678da0483ddb', 'f9daf9c9-ad88-4348-b3bd-86fd40b7536f', 'e4412da7-8397-47ab-a148-22f2b443b55e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Delete snapshot completed successfully. Sep 01 00:22:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d78b732b-9119-43f7-b38e-dd0b6cfa1c56 tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-c3cd3c5d-de41-4de6-be9a-071f541330d0-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Creating offline snapshot 6b483c2c-b424-472a-9a8e-a779448cbf99 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc14f98-b62c-40c2-a1bb-0e3ee79c502c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:39 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:39 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:39 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04" returned: 0 in 2.043s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_rchf1jgbdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:22:39 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Converted 112.00 MB image at 54.78 MB/s Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:39 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1G Sep 01 00:22:39 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:39 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.421s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:39 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 1G Sep 01 00:22:39 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:40 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 1G" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Downloaded image df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume fffd7797-ac38-468f-8ad6-03b192775c04 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 for user f2288e30c38845a884f3618f90d9cff6 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Marking volume fffd7797-ac38-468f-8ad6-03b192775c04 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Copying metadata from image df40e229-b455-4243-a6fd-53ca30610169 to fffd7797-ac38-468f-8ad6-03b192775c04. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Creating volume glance metadata for volume fffd7797-ac38-468f-8ad6-03b192775c04 backed by image df40e229-b455-4243-a6fd-53ca30610169 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce3a734-c242-4f3b-8349-39efb1e84a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffd7797-ac38-468f-8ad6-03b192775c04', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf10168-8edb-4db1-9826-e4219ecc2707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Volume volume-fffd7797-ac38-468f-8ad6-03b192775c04 (fffd7797-ac38-468f-8ad6-03b192775c04): created successfully Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf10168-8edb-4db1-9826-e4219ecc2707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (4a144714-3d4f-4ab4-9913-f2733b86a418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-081067ef-a504-42bd-9ce7-e934c5f3d598 tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:22:40 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 1G" returned: 0 in 0.561s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:40 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 Sep 01 00:22:40 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:40 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:40 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 is being set with open permissions: ugo+rw Sep 01 00:22:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:40 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 Sep 01 00:22:40 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:41 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99" returned: 0 in 0.307s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-69f0e241-4076-4aad-950e-c8b5561242b1 tempest-SnapshotsActionsTest-2058077818 None] Create snapshot completed successfully Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (b7eff32b-10a8-41f8-9d9d-d5c2ea35c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97b35e0-f57b-4d32-8f0a-9356839fa340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-6b483c2c-b424-472a-9a8e-a779448cbf99-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97b35e0-f57b-4d32-8f0a-9356839fa340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1861261774',display_name='tempest-VolumesGetTest-Volume-1436291267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8de2ce-04be-4ebd-8cc5-595e7569da83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:41Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46dac7f-8353-4ddf-ba48-3c46e27b3697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46dac7f-8353-4ddf-ba48-3c46e27b3697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e29fbf9-06b2-4df1-b1e9-7fa840fe990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e29fbf9-06b2-4df1-b1e9-7fa840fe990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8de2ce-04be-4ebd-8cc5-595e7569da83', 'volume_name': 'volume-de8de2ce-04be-4ebd-8cc5-595e7569da83', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a28355-eb3c-4782-ab82-1fe94d9b6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a28355-eb3c-4782-ab82-1fe94d9b6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba290a9-421f-4986-a694-0448516d4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Volume de8de2ce-04be-4ebd-8cc5-595e7569da83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8de2ce-04be-4ebd-8cc5-595e7569da83', 'volume_size': 1} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1861261774',display_name='tempest-VolumesGetTest-Volume-1436291267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8de2ce-04be-4ebd-8cc5-595e7569da83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d2e4811bc14d6e9704ad467a975be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:41Z,use_quota=True,user_id='f2288e30c38845a884f3618f90d9cff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Creating volume de8de2ce-04be-4ebd-8cc5-595e7569da83 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-6b483c2c-b424-472a-9a8e-a779448cbf99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:41 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 1073741824 Sep 01 00:22:41 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Acquiring lock "cinder-quobyte-6b483c2c-b424-472a-9a8e-a779448cbf99" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-6b483c2c-b424-472a-9a8e-a779448cbf99" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Deleting offline snapshot 6b483c2c-b424-472a-9a8e-a779448cbf99 of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] snapshot_file for this snap is: volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e16a4e-5911-4092-bb49-424f1c494a3c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:41 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 Sep 01 00:22:41 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:42 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 1073741824" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:42 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 Sep 01 00:22:42 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:42 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99" returned: 0 in 0.403s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f72248-4401-4261-ace1-4078a7613dd3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:42 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:42 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:42 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83" returned: 0 in 0.270s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba290a9-421f-4986-a694-0448516d4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8de2ce-04be-4ebd-8cc5-595e7569da83', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c15e68d-e9da-492c-b4ed-8c086efa69bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Volume volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 (de8de2ce-04be-4ebd-8cc5-595e7569da83): created successfully Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c15e68d-e9da-492c-b4ed-8c086efa69bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Flow 'volume_create_manager' (b7eff32b-10a8-41f8-9d9d-d5c2ea35c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8b172ef8-9a73-4aff-8aa6-92992e76249b tempest-VolumesGetTest-1872390408 None] Created volume successfully. Sep 01 00:22:42 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.383s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:42 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 Sep 01 00:22:42 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:42 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:42 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99 Sep 01 00:22:42 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:43 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.6b483c2c-b424-472a-9a8e-a779448cbf99" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-6b483c2c-b424-472a-9a8e-a779448cbf99" released by "_delete_snapshot" :: held 1.504s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_snapshot" :: held 1.529s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Created reservations ['9b615b1e-10c0-4d94-a32e-247f9e84b226', '5ff09eb1-379f-471e-96f9-dd93873ac463', '23c719f6-7242-45c8-a9ca-953f85dd0b63', 'd449af8a-3016-46ce-8a2b-98f366ff3d99'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Delete snapshot completed successfully. Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e1fdcc6-c581-4644-afd3-1c1e6c4de4fa tempest-SnapshotsActionsTest-606585751 None] Lock "cinder-6b483c2c-b424-472a-9a8e-a779448cbf99-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-de8de2ce-04be-4ebd-8cc5-595e7569da83-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "cinder-de8de2ce-04be-4ebd-8cc5-595e7569da83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-de8de2ce-04be-4ebd-8cc5-595e7569da83" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-de8de2ce-04be-4ebd-8cc5-595e7569da83" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d726d9a-3ffc-4d2b-8f75-114db2657f0c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:43 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 Sep 01 00:22:43 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:44 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83" returned: 0 in 0.461s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "cinder-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:44 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83 Sep 01 00:22:44 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "cinder-quobyte-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Deleting offline snapshot 78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d of volume dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] snapshot_file for this snap is: volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[03777031-0141-4f03-b23e-67bfdc566f89]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:44 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:44 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:44 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-de8de2ce-04be-4ebd-8cc5-595e7569da83" returned: 0 in 0.342s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-de8de2ce-04be-4ebd-8cc5-595e7569da83" released by "delete_volume" :: held 0.857s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Created reservations ['ac892a69-027d-4efe-869c-70dc9b29fb65', '64936248-0a6c-4945-8fd0-19811e035fa3', '71bfc881-6cf4-4866-9130-11f924cc8835', 'a130adeb-0a3e-4dd1-9dd6-11f8e1982491'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:44 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409e9a5-16fd-4869-8f9d-6937864c0950]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:44 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 Sep 01 00:22:44 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-fffd7797-ac38-468f-8ad6-03b192775c04-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-fffd7797-ac38-468f-8ad6-03b192775c04-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:44 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "cinder-quobyte-fffd7797-ac38-468f-8ad6-03b192775c04" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-fffd7797-ac38-468f-8ad6-03b192775c04" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5e4caf98-0417-4082-9c03-3d7d7bb8830e tempest-VolumesGetTest-1872390408 None] Lock "cinder-de8de2ce-04be-4ebd-8cc5-595e7569da83-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f7336-f81d-46da-bdda-1be5edc4f844]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:45 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 Sep 01 00:22:45 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:45 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" returned: 0 in 0.465s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:45 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:45 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:45 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04" returned: 0 in 0.442s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:45 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04 Sep 01 00:22:45 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:45 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:45 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d Sep 01 00:22:45 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:45 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fffd7797-ac38-468f-8ad6-03b192775c04" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-quobyte-fffd7797-ac38-468f-8ad6-03b192775c04" released by "delete_volume" :: held 0.759s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Created reservations ['18e24a3c-5439-4fb9-a6af-ea9d02bb8723', 'ddb9dafd-14f8-45d3-9a5e-e929ed183beb', '398ffb09-2d26-45ff-b85b-1d976f1c138c', '3d6abf72-8014-4553-b914-78e42883668d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:45 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976.78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" returned: 0 in 0.283s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:45 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:45 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d" released by "_delete_snapshot" :: held 1.709s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_snapshot" :: held 1.733s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Created reservations ['34adde63-cc4c-4542-91b2-d75f377cb32a', 'c47cbb6b-6b5f-40c7-8fcf-4830113d1344', 'ad2c7116-d154-488f-b961-72b33da2094e', '67fc0d8f-47fd-4638-ac27-d5c64c6e5a65'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Delete snapshot completed successfully. Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb2d60c5-9ccf-44df-9a57-a0d9e2b308e7 tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-78bc8fe3-3e09-4e50-aa62-cc10dce4bf8d-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:46 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Deleted volume successfully. Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a98c8d7-1cc3-4991-9337-f3e3d2f048c0 tempest-VolumesGetTest-1872390408 None] Lock "cinder-fffd7797-ac38-468f-8ad6-03b192775c04-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "cinder-dcc30dbd-634a-4b7d-85a6-75ec3a96e976-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-dcc30dbd-634a-4b7d-85a6-75ec3a96e976-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39b945-9517-4d4c-bbbd-d8a9af38e50a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:46 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 Sep 01 00:22:46 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:46 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:46 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976 Sep 01 00:22:46 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:47 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-quobyte-dcc30dbd-634a-4b7d-85a6-75ec3a96e976" released by "delete_volume" :: held 0.921s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Created reservations ['c4067d9c-8c16-4e6a-9f1a-f09911c1997b', '02025a3a-5749-47ef-9103-a53bae24f7ae', '47a82304-98e8-4bda-af89-97483962869f', '444e6827-b7f4-4f2b-acc5-d4d1fa96caf3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:47 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:22:47 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:47 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:22:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Deleted volume successfully. Sep 01 00:22:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c4a69cd4-ed9a-4e8f-9763-3e6f5f7b151d tempest-SnapshotsActionsTest-2058077818 None] Lock "cinder-dcc30dbd-634a-4b7d-85a6-75ec3a96e976-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (4fd8c3f9-2717-417a-9f20-843d15e6b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2118dd-ecfb-4d3c-81de-46817cd0075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2118dd-ecfb-4d3c-81de-46817cd0075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1294470931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d0d2e2-a35a-436a-b751-8e6fc031678f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:51Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d194dc-adc0-4cdf-b5a0-913c56ed8b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d194dc-adc0-4cdf-b5a0-913c56ed8b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b0dfcc-9254-4d8b-a78a-a2a0cae62d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b0dfcc-9254-4d8b-a78a-a2a0cae62d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d0d2e2-a35a-436a-b751-8e6fc031678f', 'volume_name': 'volume-63d0d2e2-a35a-436a-b751-8e6fc031678f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1a13ed-167e-45f4-97a5-8bdc5f88d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1a13ed-167e-45f4-97a5-8bdc5f88d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5146d043-f6e7-48ed-9bdf-26abc37eaa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:50 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Volume 63d0d2e2-a35a-436a-b751-8e6fc031678f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d0d2e2-a35a-436a-b751-8e6fc031678f', 'volume_size': 1} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1294470931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d0d2e2-a35a-436a-b751-8e6fc031678f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:51Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Creating volume 63d0d2e2-a35a-436a-b751-8e6fc031678f {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:51 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:51 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f 1073741824 Sep 01 00:22:51 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:51 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f 1073741824" returned: 0 in 0.568s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:51 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f Sep 01 00:22:51 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:51 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5146d043-f6e7-48ed-9bdf-26abc37eaa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d0d2e2-a35a-436a-b751-8e6fc031678f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad01c6ee-6779-45e6-9e7f-b6144be9c3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:52 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Volume volume-63d0d2e2-a35a-436a-b751-8e6fc031678f (63d0d2e2-a35a-436a-b751-8e6fc031678f): created successfully Sep 01 00:22:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad01c6ee-6779-45e6-9e7f-b6144be9c3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (4fd8c3f9-2717-417a-9f20-843d15e6b098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7e2c39d5-c41b-41a6-b87c-786c45306ce4 tempest-AttachVolumeNegativeTest-1698104254 None] Created volume successfully. Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-22fe12aa-569a-43f1-b67d-138576b8ecc6 req-2c7e6565-5f03-4c6f-bf20-427d7b342129 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-22fe12aa-569a-43f1-b67d-138576b8ecc6 req-2c7e6565-5f03-4c6f-bf20-427d7b342129 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Flow 'volume_create_manager' (8a79196f-620e-42af-adc0-bb782a3c708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332281d-ffe3-45d3-bf7c-6ee6eace2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-22fe12aa-569a-43f1-b67d-138576b8ecc6 req-2c7e6565-5f03-4c6f-bf20-427d7b342129 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b332281d-ffe3-45d3-bf7c-6ee6eace2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-19783472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bb5382-8279-46ea-bfd9-24714bf77bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c82a1783486dbc755ce7cfcabfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:54Z,use_quota=True,user_id='54d99c12c86a4d6db36426d4209907c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850af87b-63a7-464e-aba0-6cac486bc2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850af87b-63a7-464e-aba0-6cac486bc2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2fa8cd-eb42-4917-aed3-119d0884274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2fa8cd-eb42-4917-aed3-119d0884274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bb5382-8279-46ea-bfd9-24714bf77bd1', 'volume_name': 'volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a35e8-d45a-49c7-8899-5574c56588b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566a35e8-d45a-49c7-8899-5574c56588b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a174f280-00e8-4c57-8ec4-57489df36e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Volume f3bb5382-8279-46ea-bfd9-24714bf77bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1', 'volume_size': 1} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-19783472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bb5382-8279-46ea-bfd9-24714bf77bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c82a1783486dbc755ce7cfcabfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:54Z,use_quota=True,user_id='54d99c12c86a4d6db36426d4209907c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Creating volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:54 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 1073741824 Sep 01 00:22:54 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-22fe12aa-569a-43f1-b67d-138576b8ecc6 req-2c7e6565-5f03-4c6f-bf20-427d7b342129 tempest-AttachVolumeNegativeTest-1698104254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-63d0d2e2-a35a-436a-b751-8e6fc031678f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40b21ae0-9f28-4a18-be03-6d6e80181a62', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:22:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-22fe12aa-569a-43f1-b67d-138576b8ecc6 req-2c7e6565-5f03-4c6f-bf20-427d7b342129 tempest-AttachVolumeNegativeTest-1698104254 None] attachment_update completed successfully. Sep 01 00:22:54 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 1073741824" returned: 0 in 0.571s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:55 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 Sep 01 00:22:55 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:55 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1" returned: 0 in 0.392s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a174f280-00e8-4c57-8ec4-57489df36e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff18f20-8ff4-4571-b962-382a35ffedd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Volume volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 (f3bb5382-8279-46ea-bfd9-24714bf77bd1): created successfully Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff18f20-8ff4-4571-b962-382a35ffedd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Flow 'volume_create_manager' (8a79196f-620e-42af-adc0-bb782a3c708c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-05589eef-c6ab-4741-9878-3447daed5c4a tempest-VolumesSnapshotListTestJSON-1062073842 None] Created volume successfully. Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Flow 'volume_create_manager' (e7f1ee13-05f6-447b-be27-4a6ecf4fa504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fa9529-51a6-4ec5-aa2d-6ce8c9f40af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fa9529-51a6-4ec5-aa2d-6ce8c9f40af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1907253255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2817ee3fa94bc8a29a94c0e1b06b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:56Z,use_quota=True,user_id='a1df34ef6612441bbd3c3b8b518ecc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23596843-d9bf-4439-8fb3-144ac1a12409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23596843-d9bf-4439-8fb3-144ac1a12409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56405bbd-139b-4e8e-b268-cdb1481e11a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56405bbd-139b-4e8e-b268-cdb1481e11a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9', 'volume_name': 'volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5faf15b-ecec-4f55-b089-ca0d28de8d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5faf15b-ecec-4f55-b089-ca0d28de8d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7651a2-002c-4702-8d2e-1ea2df933b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Volume 6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9', 'volume_size': 1} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1907253255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2817ee3fa94bc8a29a94c0e1b06b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:56Z,use_quota=True,user_id='a1df34ef6612441bbd3c3b8b518ecc27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Creating volume 6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:56 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:56 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 1073741824 Sep 01 00:22:56 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:57 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 1073741824" returned: 0 in 0.619s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:57 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 Sep 01 00:22:57 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Flow 'volume_create_manager' (afdc7b54-3d22-4832-9656-fe54ff8399d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5a99ce-ec55-4da0-b0fb-7002c42a500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5a99ce-ec55-4da0-b0fb-7002c42a500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1616766916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4bae9b-f218-4521-9262-4a4b2271ce2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb92ccf655646b59e41e55ba943660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:57Z,use_quota=True,user_id='1e46a817b51f4544a428a60f10e45f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82783960-5609-47b2-80f8-244aa577ab0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82783960-5609-47b2-80f8-244aa577ab0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c5f4a1-f1a4-4058-a2d0-06ba085927e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c5f4a1-f1a4-4058-a2d0-06ba085927e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4bae9b-f218-4521-9262-4a4b2271ce2a', 'volume_name': 'volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec08f39e-9ef1-4d49-a9f5-091668c8c49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec08f39e-9ef1-4d49-a9f5-091668c8c49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632676b5-3a8d-4cf1-9e74-eb22d6e75ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume 1f4bae9b-f218-4521-9262-4a4b2271ce2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a', 'volume_size': 1} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:57 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.693s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7651a2-002c-4702-8d2e-1ea2df933b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa89e0-0948-4803-8e2a-139db1659cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Creating offline snapshot 1ea1e441-6502-44f5-a0b8-531f464af682 of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:22:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Volume volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 (6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9): created successfully Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa89e0-0948-4803-8e2a-139db1659cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Flow 'volume_create_manager' (e7f1ee13-05f6-447b-be27-4a6ecf4fa504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf474467-43c3-44e0-833b-c4e0617cbd44]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-342fee90-1fd5-4d52-af76-4d6155fead19 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Created volume successfully. Sep 01 00:22:57 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 Sep 01 00:22:57 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:57 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:57 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 1G Sep 01 00:22:57 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:58 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 1G" returned: 0 in 0.448s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:58 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:22:58 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:58 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.332s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:58 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 is being set with open permissions: ugo+rw Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:58 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:22:58 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:58 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.266s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:59 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info Sep 01 00:22:59 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:59 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:59 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info is being set with open permissions: ugo+rw Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:59 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info Sep 01 00:22:59 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:59 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.info" returned: 0 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1616766916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4bae9b-f218-4521-9262-4a4b2271ce2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb92ccf655646b59e41e55ba943660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:22:57Z,use_quota=True,user_id='1e46a817b51f4544a428a60f10e45f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Creating volume 1f4bae9b-f218-4521-9262-4a4b2271ce2a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:22:59 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:22:59 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a 1073741824 Sep 01 00:22:59 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Acquiring lock "cinder-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5525c2b0-1592-4b04-8109-b3479d3c29ec tempest-VolumesSnapshotListTestJSON-1062073842 None] Create snapshot completed successfully Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "cinder-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Acquiring lock "cinder-quobyte-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "cinder-quobyte-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f6f1a0-af3a-4cd7-bdc2-e883105f3ae5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:22:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:00 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 Sep 01 00:23:00 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:00 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a 1073741824" returned: 0 in 0.595s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:00 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a Sep 01 00:23:00 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:00 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" returned: 0 in 0.496s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:00 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9 Sep 01 00:23:00 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:00 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.439s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Creating offline snapshot e6277f2c-c570-4900-a5f9-fea6c51f86bc of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:23:00 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632676b5-3a8d-4cf1-9e74-eb22d6e75ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88cde2-7e53-4d77-9ef6-360b750a3250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "cinder-quobyte-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9" released by "delete_volume" :: held 0.874s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[595e5c49-e4d2-47fc-8cf2-d558a3a0bdf3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a (1f4bae9b-f218-4521-9262-4a4b2271ce2a): created successfully Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb88cde2-7e53-4d77-9ef6-360b750a3250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Flow 'volume_create_manager' (afdc7b54-3d22-4832-9656-fe54ff8399d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:00 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-25d9810e-b7b7-4035-9ab9-de4c9163e0ce tempest-VolumeQuotasAdminTestJSON-1473843728 None] Created volume successfully. Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Created reservations ['6f45a100-2074-4852-b74f-c8f417f65f44', 'db2ca97a-a085-4c7f-91cd-1014cf5bce30', 'e0b2c66d-85dc-413c-b90d-8b2114f65092', '56cef02b-b64f-4f72-b5cc-8b45bf3069ed'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:00 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:23:00 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:00 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:00 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:01 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.563s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:01 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:01 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc 1G Sep 01 00:23:01 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Deleted volume successfully. Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbafc7a4-b0e2-4130-b5fa-eea77e2b6006 tempest-VolumeQuotasNegativeTestJSON-2099832702 None] Lock "cinder-6b8f89ed-260a-4947-ae87-ab2a3e0ac3c9-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "cinder-1f4bae9b-f218-4521-9262-4a4b2271ce2a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "cinder-1f4bae9b-f218-4521-9262-4a4b2271ce2a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "cinder-quobyte-1f4bae9b-f218-4521-9262-4a4b2271ce2a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "cinder-quobyte-1f4bae9b-f218-4521-9262-4a4b2271ce2a" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[206fa99a-f1ac-4369-bf0e-38e8dd244348]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:02 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc 1G" returned: 0 in 0.872s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:02 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a Sep 01 00:23:02 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:02 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:02 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:02 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:02 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc is being set with open permissions: ugo+rw Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:02 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:02 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:02 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a" returned: 0 in 0.642s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:02 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a Sep 01 00:23:02 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:02 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.356s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:02 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f4bae9b-f218-4521-9262-4a4b2271ce2a" returned: 0 in 0.319s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "cinder-quobyte-1f4bae9b-f218-4521-9262-4a4b2271ce2a" released by "delete_volume" :: held 1.047s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6d0e0533-5fef-4682-96f6-1073ab990c02 tempest-VolumesSnapshotListTestJSON-1062073842 None] Create snapshot completed successfully Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Created reservations ['057090f9-97a4-43c0-ac21-4c737c3a8eb4', '35b5d45e-e9f4-4055-96ac-14d4ac3cf6f3', '5a891c50-ee48-49f8-8597-8deedea41ba5', 'eee7a7de-21fc-4265-b3a7-80632176608c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:03 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:03 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:03 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.358s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Deleted volume successfully. Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3394e266-61cb-4993-b187-624ef2333289 tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "cinder-1f4bae9b-f218-4521-9262-4a4b2271ce2a-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Creating offline snapshot c0100591-e0bd-42e1-84d9-cdbde941d33f of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e73068c-d9ee-48cc-a78e-f021ab2d2125]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:03 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:03 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:04 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.467s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:04 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f 1G Sep 01 00:23:04 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=123,cinder:INSERT=44,cinder:UPDATE=155,cinder:DELETE=16 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=136,cinder:INSERT=43,cinder:UPDATE=145,cinder:DELETE=11 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Flow 'volume_create_manager' (bfef8f87-4201-4df3-b7eb-6c90795f16a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f32c1ec-dd90-496c-86f9-eb174ca12608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:05 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f32c1ec-dd90-496c-86f9-eb174ca12608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-686595716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c07747-0c38-4df5-9f88-5ed98726ef7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb92ccf655646b59e41e55ba943660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:05Z,use_quota=True,user_id='1e46a817b51f4544a428a60f10e45f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd7d3e-0564-4cb2-b8e4-f9cddf2a1995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2dd7d3e-0564-4cb2-b8e4-f9cddf2a1995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b641db-ca9b-4fd3-97c3-7982d000fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b641db-ca9b-4fd3-97c3-7982d000fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c07747-0c38-4df5-9f88-5ed98726ef7a', 'volume_name': 'volume-26c07747-0c38-4df5-9f88-5ed98726ef7a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65f702d-a199-4e03-981c-2131bdeb156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65f702d-a199-4e03-981c-2131bdeb156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105a1072-b0a9-4a09-972b-e4ca8d1d7524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume 26c07747-0c38-4df5-9f88-5ed98726ef7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c07747-0c38-4df5-9f88-5ed98726ef7a', 'volume_size': 1} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f 1G" returned: 0 in 0.972s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:05 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f Sep 01 00:23:05 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:05 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f" returned: 0 in 0.478s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:05 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f is being set with open permissions: ugo+rw Sep 01 00:23:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:05 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f Sep 01 00:23:05 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:06 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f" returned: 0 in 0.541s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.586s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-686595716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c07747-0c38-4df5-9f88-5ed98726ef7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb92ccf655646b59e41e55ba943660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:05Z,use_quota=True,user_id='1e46a817b51f4544a428a60f10e45f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Creating volume 26c07747-0c38-4df5-9f88-5ed98726ef7a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:06 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:06 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a 1073741824 Sep 01 00:23:06 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f53878cb-3c57-4669-8070-12179f25fac2 tempest-VolumesSnapshotListTestJSON-1062073842 None] Create snapshot completed successfully Sep 01 00:23:07 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a 1073741824" returned: 0 in 0.754s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:07 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a Sep 01 00:23:07 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:07 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a" returned: 0 in 0.503s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105a1072-b0a9-4a09-972b-e4ca8d1d7524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c07747-0c38-4df5-9f88-5ed98726ef7a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9055e43-4f9b-4c5b-93b9-48cfaf577cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Volume volume-26c07747-0c38-4df5-9f88-5ed98726ef7a (26c07747-0c38-4df5-9f88-5ed98726ef7a): created successfully Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9055e43-4f9b-4c5b-93b9-48cfaf577cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Flow 'volume_create_manager' (bfef8f87-4201-4df3-b7eb-6c90795f16a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bbe9a56e-b2af-45ea-87ce-7829f931317a tempest-VolumeQuotasAdminTestJSON-1473843728 None] Created volume successfully. Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-c0100591-e0bd-42e1-84d9-cdbde941d33f-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-c0100591-e0bd-42e1-84d9-cdbde941d33f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-c0100591-e0bd-42e1-84d9-cdbde941d33f" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-c0100591-e0bd-42e1-84d9-cdbde941d33f" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Deleting offline snapshot c0100591-e0bd-42e1-84d9-cdbde941d33f of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] snapshot_file for this snap is: volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee74b34-8852-422a-82bb-333837523bef]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:08 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f Sep 01 00:23:08 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:08 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f" returned: 0 in 0.608s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa25cef-97f1-433a-9faf-d7e7cc495153]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:09 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:09 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:09 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.556s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bb7affd6-4f13-436d-a657-56c1f10cd730 tempest-VolumeQuotasAdminTestJSON-832397085 None] Transfer volume completed successfully. Sep 01 00:23:09 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f Sep 01 00:23:09 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Flow 'volume_create_manager' (923d0f0e-02e9-42e4-863a-51b2f8bf7c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f2e577-52e9-4ddf-adf5-4b62d630fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f2e577-52e9-4ddf-adf5-4b62d630fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-622855647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e24be84-a781-4a92-b1da-51ba6e42770c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7272dd2d31464ce7ad3b341303380d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:10Z,use_quota=True,user_id='b0b04917ac164dad99523063c076ffd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69feea4b-52df-4e1e-aa76-9c88396c3727),volume_type_id=69feea4b-52df-4e1e-aa76-9c88396c3727)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e91c3c4-da4e-419d-9d77-cda80c59bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e91c3c4-da4e-419d-9d77-cda80c59bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d8dba4-72f5-40c9-b0e6-814bdf811fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d8dba4-72f5-40c9-b0e6-814bdf811fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e24be84-a781-4a92-b1da-51ba6e42770c', 'volume_name': 'volume-0e24be84-a781-4a92-b1da-51ba6e42770c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e744b207-4b9c-496f-ac19-9d45cbf14448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e744b207-4b9c-496f-ac19-9d45cbf14448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1174e670-b0e7-46f2-82d2-1f48dd58d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:10 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Volume 0e24be84-a781-4a92-b1da-51ba6e42770c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e24be84-a781-4a92-b1da-51ba6e42770c', 'volume_size': 1} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-622855647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e24be84-a781-4a92-b1da-51ba6e42770c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7272dd2d31464ce7ad3b341303380d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:10Z,use_quota=True,user_id='b0b04917ac164dad99523063c076ffd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69feea4b-52df-4e1e-aa76-9c88396c3727),volume_type_id=69feea4b-52df-4e1e-aa76-9c88396c3727)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Creating volume 0e24be84-a781-4a92-b1da-51ba6e42770c {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:10 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:10 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c 1073741824 Sep 01 00:23:10 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Acquiring lock "cinder-26c07747-0c38-4df5-9f88-5ed98726ef7a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:10 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "cinder-26c07747-0c38-4df5-9f88-5ed98726ef7a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f" returned: 0 in 0.867s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:10 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f Sep 01 00:23:10 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Acquiring lock "cinder-quobyte-26c07747-0c38-4df5-9f88-5ed98726ef7a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "cinder-quobyte-26c07747-0c38-4df5-9f88-5ed98726ef7a" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbd255d-1d0b-45d5-95c7-4a872ad793b8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:10 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a Sep 01 00:23:10 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:10 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.c0100591-e0bd-42e1-84d9-cdbde941d33f" returned: 0 in 0.291s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-c0100591-e0bd-42e1-84d9-cdbde941d33f" released by "_delete_snapshot" :: held 2.493s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:10 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c 1073741824" returned: 0 in 0.531s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" released by "delete_snapshot" :: held 2.557s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:10 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c Sep 01 00:23:10 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:10 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Created reservations ['db785690-f012-4019-931b-c182e9942c2f', '184ba978-241b-4ebb-a445-974a6ec301d7', '88050301-0e88-43dd-95b9-51032ab295bc', '15e5f0ae-df00-43aa-a765-53f072c53b51'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Delete snapshot completed successfully. Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c09706c-311c-4752-95d5-0bcec0742618 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-c0100591-e0bd-42e1-84d9-cdbde941d33f-delete_snapshot" released by "delete_snapshot" :: held 2.912s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:11 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a" returned: 0 in 0.525s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:11 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a Sep 01 00:23:11 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:11 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c" returned: 0 in 0.358s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1174e670-b0e7-46f2-82d2-1f48dd58d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e24be84-a781-4a92-b1da-51ba6e42770c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dca48f-5a6d-42e7-9f51-a40d16065e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:11 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Volume volume-0e24be84-a781-4a92-b1da-51ba6e42770c (0e24be84-a781-4a92-b1da-51ba6e42770c): created successfully Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dca48f-5a6d-42e7-9f51-a40d16065e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Flow 'volume_create_manager' (923d0f0e-02e9-42e4-863a-51b2f8bf7c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ab8e2bf9-a64c-423a-b629-6d13cb9cee0b tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Created volume successfully. Sep 01 00:23:11 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-26c07747-0c38-4df5-9f88-5ed98726ef7a" returned: 0 in 0.258s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "cinder-quobyte-26c07747-0c38-4df5-9f88-5ed98726ef7a" released by "delete_volume" :: held 0.819s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Created reservations ['a39a45db-43a1-4772-9a96-224fe5911199', '9a38d3a8-2a6f-4e60-8480-fc0a5bff0c13', '59484e31-b981-4ef7-a4f0-2442a1afc9cf', 'e30643f3-2716-42d4-a207-426640b813bf'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:11 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:11 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:11 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Deleted volume successfully. Sep 01 00:23:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2d65415d-3f1f-47be-a5af-533cd4e6d4d4 tempest-VolumeQuotasAdminTestJSON-1976975206 None] Lock "cinder-26c07747-0c38-4df5-9f88-5ed98726ef7a-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-e6277f2c-c570-4900-a5f9-fea6c51f86bc-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-e6277f2c-c570-4900-a5f9-fea6c51f86bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-e6277f2c-c570-4900-a5f9-fea6c51f86bc" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-e6277f2c-c570-4900-a5f9-fea6c51f86bc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Deleting offline snapshot e6277f2c-c570-4900-a5f9-fea6c51f86bc of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] snapshot_file for this snap is: volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df7d2d-713e-4d0f-bbbe-896ab3325604]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:12 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:12 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:12 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[077bcc1b-6fcc-4f01-9123-c82406480030]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:12 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:12 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:12 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:23:12 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:13 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.328s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b220539f-35cd-4fbe-9f4e-dca19fe55e38 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Retype volume completed successfully. Sep 01 00:23:13 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.517s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:13 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:13 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:13 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:13 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:13 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.440s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:13 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc Sep 01 00:23:13 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:14 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.408s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:23:14 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.e6277f2c-c570-4900-a5f9-fea6c51f86bc" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-e6277f2c-c570-4900-a5f9-fea6c51f86bc" released by "_delete_snapshot" :: held 1.980s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" released by "delete_snapshot" :: held 2.015s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Created reservations ['d9482e77-fac2-421f-ad39-455754cccde2', '25b359d3-44bf-4712-8fc6-7deac547a2ff', 'e6c0777b-812f-4f1a-8cd8-42976617684d', '8bf28dcc-abab-47b6-ac45-f36320e750da'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "cinder-0e24be84-a781-4a92-b1da-51ba6e42770c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "cinder-0e24be84-a781-4a92-b1da-51ba6e42770c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Delete snapshot completed successfully. Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "cinder-quobyte-0e24be84-a781-4a92-b1da-51ba6e42770c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0243353b-c373-423e-bec3-601ceb36f4f0 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-e6277f2c-c570-4900-a5f9-fea6c51f86bc-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "cinder-quobyte-0e24be84-a781-4a92-b1da-51ba6e42770c" acquired by "delete_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b676bf2b-3658-4f4f-bcdd-bb8112eaac6d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:14 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c Sep 01 00:23:14 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:14 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c" returned: 0 in 0.448s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:14 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c Sep 01 00:23:14 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:15 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0e24be84-a781-4a92-b1da-51ba6e42770c" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "cinder-quobyte-0e24be84-a781-4a92-b1da-51ba6e42770c" released by "delete_volume" :: held 0.832s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:15 devstack cinder-volume[87803]: WARNING cinder.quota [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:23:15 devstack cinder-volume[87803]: WARNING cinder.quota [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-1ea1e441-6502-44f5-a0b8-531f464af682-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Created reservations ['e2d1cd12-9eaa-4eb1-ba20-f3cf7889264d', '6d024c7d-59ad-47cc-be82-0920a9516f2d', 'c33c11b1-cd17-44c2-ab70-8cf66dce119d', '5841540c-edfe-4019-b7dc-a0725951e073'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-1ea1e441-6502-44f5-a0b8-531f464af682-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-1ea1e441-6502-44f5-a0b8-531f464af682" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-1ea1e441-6502-44f5-a0b8-531f464af682" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Deleting offline snapshot 1ea1e441-6502-44f5-a0b8-531f464af682 of volume f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] snapshot_file for this snap is: volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e878d031-d1e1-4e33-b947-be78610a245d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:15 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:15 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:15 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:23:15 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:16 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.426s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Deleted volume successfully. Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7ec79fa-ee4b-4f2c-80c1-1f60273c3bd2 tempest-VolumeRetypeWithoutMigrationTest-96437302 None] Lock "cinder-0e24be84-a781-4a92-b1da-51ba6e42770c-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:16 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.628s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ffde8-a0c3-486b-8d73-4bee2273082c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:16 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 Sep 01 00:23:16 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:16 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1" returned: 0 in 0.579s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:16 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:23:16 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:17 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.672s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:17 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682 Sep 01 00:23:17 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:17 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1.1ea1e441-6502-44f5-a0b8-531f464af682" returned: 0 in 0.308s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-1ea1e441-6502-44f5-a0b8-531f464af682" released by "_delete_snapshot" :: held 2.370s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" released by "delete_snapshot" :: held 2.426s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Created reservations ['61032d85-b765-4f13-bfc3-fcb967bb6608', 'eee3da62-8138-46c0-87da-4531e93cdcd3', 'c20aed71-8e05-4bb9-9e69-e15b49bc88e2', 'b405a850-e02d-4276-87f4-2a3213a4c3ba'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Delete snapshot completed successfully. Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e8a1a50f-d9a3-4fbb-804e-043a377111ce tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-1ea1e441-6502-44f5-a0b8-531f464af682-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-f3bb5382-8279-46ea-bfd9-24714bf77bd1-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-f3bb5382-8279-46ea-bfd9-24714bf77bd1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf53685-1c0a-40f7-8173-43836c4c2352]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:19 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 Sep 01 00:23:19 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:19 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:19 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1 Sep 01 00:23:19 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:19 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f3bb5382-8279-46ea-bfd9-24714bf77bd1" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-quobyte-f3bb5382-8279-46ea-bfd9-24714bf77bd1" released by "delete_volume" :: held 0.831s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Created reservations ['ce956361-5978-406d-bfb2-9025b3199707', '0d90cecf-53a5-42ef-a007-d3faf6c44099', 'a3e7649f-b3c1-4a70-9415-dc4ee97c7272', '8e71352f-ac54-4d93-8b15-2633cce97e94'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:19 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:19 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:20 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:20 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Deleted volume successfully. Sep 01 00:23:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-25c996bd-a6f4-475e-937a-1c062afcc6c6 tempest-VolumesSnapshotListTestJSON-1062073842 None] Lock "cinder-f3bb5382-8279-46ea-bfd9-24714bf77bd1-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Flow 'volume_create_manager' (ac0005cf-5966-478b-ad93-61c9df068ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36075ada-bd0a-41e4-a47b-fd0c2bc7da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36075ada-bd0a-41e4-a47b-fd0c2bc7da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1901534030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef1e0ef-124e-4f5e-88f4-8b0688512318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b24d65495194a5e9a28f01ffcde3a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:28Z,use_quota=True,user_id='ec3f1876c8d549f9bd9ed5ec345b7aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6789a0e7-df1d-4a74-92c2-3a451094f3b8),volume_type_id=6789a0e7-df1d-4a74-92c2-3a451094f3b8)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff897425-ae14-4e36-acd7-fc6cbd63f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff897425-ae14-4e36-acd7-fc6cbd63f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be1c40c-56c6-4a7a-8e05-0d01735da18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be1c40c-56c6-4a7a-8e05-0d01735da18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef1e0ef-124e-4f5e-88f4-8b0688512318', 'volume_name': 'volume-cef1e0ef-124e-4f5e-88f4-8b0688512318', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ee578d-e84b-4d3e-9fd9-cd53b70839db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ee578d-e84b-4d3e-9fd9-cd53b70839db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc676a5b-ed37-4fab-8c8a-10e0145e462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Volume cef1e0ef-124e-4f5e-88f4-8b0688512318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef1e0ef-124e-4f5e-88f4-8b0688512318', 'volume_size': 1} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1901534030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef1e0ef-124e-4f5e-88f4-8b0688512318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b24d65495194a5e9a28f01ffcde3a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:28Z,use_quota=True,user_id='ec3f1876c8d549f9bd9ed5ec345b7aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6789a0e7-df1d-4a74-92c2-3a451094f3b8),volume_type_id=6789a0e7-df1d-4a74-92c2-3a451094f3b8)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Creating volume cef1e0ef-124e-4f5e-88f4-8b0688512318 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:28 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:28 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 1073741824 Sep 01 00:23:28 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:28 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 1073741824" returned: 0 in 0.700s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:29 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 Sep 01 00:23:29 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:29 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc676a5b-ed37-4fab-8c8a-10e0145e462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef1e0ef-124e-4f5e-88f4-8b0688512318', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211887b6-73e7-497f-a743-5a31dbe26e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Volume volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 (cef1e0ef-124e-4f5e-88f4-8b0688512318): created successfully Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211887b6-73e7-497f-a743-5a31dbe26e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Flow 'volume_create_manager' (ac0005cf-5966-478b-ad93-61c9df068ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e199236c-01dc-4dca-9cb8-57296ab8296f tempest-VolumeTypesAccessTest-1341744773 None] Created volume successfully. Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (f6611d05-4213-452e-a5e6-00eaba647eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c3a81b-d7db-462d-9edd-c8ddd929dd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c3a81b-d7db-462d-9edd-c8ddd929dd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-232274885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49eaf840-6805-4e15-a063-179d0282311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:30Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7571719f-606e-45d8-92b6-9a14d3422fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7571719f-606e-45d8-92b6-9a14d3422fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f220c0b9-a098-486c-bea1-b2b8edcf97be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f220c0b9-a098-486c-bea1-b2b8edcf97be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49eaf840-6805-4e15-a063-179d0282311b', 'volume_name': 'volume-49eaf840-6805-4e15-a063-179d0282311b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869dcf56-4d7d-4d18-bf1c-806f48a8faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869dcf56-4d7d-4d18-bf1c-806f48a8faf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfd58dc-dd39-4923-9c02-aa51181a2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Volume 49eaf840-6805-4e15-a063-179d0282311b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49eaf840-6805-4e15-a063-179d0282311b', 'volume_size': 1} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-232274885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49eaf840-6805-4e15-a063-179d0282311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:30Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Creating volume 49eaf840-6805-4e15-a063-179d0282311b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:29 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b 1073741824 Sep 01 00:23:29 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Acquiring lock "cinder-cef1e0ef-124e-4f5e-88f4-8b0688512318-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "cinder-cef1e0ef-124e-4f5e-88f4-8b0688512318-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:30 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b 1073741824" returned: 0 in 0.613s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Acquiring lock "cinder-quobyte-cef1e0ef-124e-4f5e-88f4-8b0688512318" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "cinder-quobyte-cef1e0ef-124e-4f5e-88f4-8b0688512318" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d892d4b5-82a5-42f4-8843-85e1f3437838]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:30 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b Sep 01 00:23:30 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:30 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 Sep 01 00:23:30 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:30 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b" returned: 0 in 0.349s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfd58dc-dd39-4923-9c02-aa51181a2efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49eaf840-6805-4e15-a063-179d0282311b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002087c-1298-4244-a131-71b60c64ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Volume volume-49eaf840-6805-4e15-a063-179d0282311b (49eaf840-6805-4e15-a063-179d0282311b): created successfully Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002087c-1298-4244-a131-71b60c64ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (f6611d05-4213-452e-a5e6-00eaba647eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2e80721f-e599-4880-89a7-b73618e86a39 tempest-VolumesListAdminTestJSON-2120919161 None] Created volume successfully. Sep 01 00:23:31 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318" returned: 0 in 0.529s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:31 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318 Sep 01 00:23:31 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:31 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cef1e0ef-124e-4f5e-88f4-8b0688512318" returned: 0 in 0.331s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "cinder-quobyte-cef1e0ef-124e-4f5e-88f4-8b0688512318" released by "delete_volume" :: held 0.922s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:31 devstack cinder-volume[87803]: WARNING cinder.quota [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-624725848 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-624725848, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:23:31 devstack cinder-volume[87803]: WARNING cinder.quota [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-624725848 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-624725848, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Created reservations ['3709e993-cf0a-41fa-ad27-e10730b5ce84', '7d0aa236-fb5d-42d4-a7e6-f1615b8200dc', '25933083-32f4-47b2-8cf9-ec2eccb415bc', 'b92582a8-50ac-4792-a5f6-bd9588c890ba'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:31 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:31 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:31 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.307s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:31 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Deleted volume successfully. Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cbed9e1e-c54c-4d7b-8f09-ab1f6f7aa3cd tempest-VolumeTypesAccessTest-1341744773 None] Lock "cinder-cef1e0ef-124e-4f5e-88f4-8b0688512318-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (3b8cc095-d25c-4b34-b885-ff5ea64df7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea947007-3665-4f8c-9b54-4d0a7c3b1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea947007-3665-4f8c-9b54-4d0a7c3b1201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1246389358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817c87bb-5703-4394-b755-f010be1e1589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:32Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95f5318-0497-4972-bebf-41518fea8eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95f5318-0497-4972-bebf-41518fea8eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fff4a-b578-4b6f-a857-cae7d5d76d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fff4a-b578-4b6f-a857-cae7d5d76d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817c87bb-5703-4394-b755-f010be1e1589', 'volume_name': 'volume-817c87bb-5703-4394-b755-f010be1e1589', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42470bec-7900-4c73-a8fb-172482f98fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42470bec-7900-4c73-a8fb-172482f98fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89faf4e3-23f3-4805-8710-dfe1785ad8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Volume 817c87bb-5703-4394-b755-f010be1e1589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817c87bb-5703-4394-b755-f010be1e1589', 'volume_size': 1} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1246389358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817c87bb-5703-4394-b755-f010be1e1589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:32Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Creating volume 817c87bb-5703-4394-b755-f010be1e1589 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:32 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:32 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 1073741824 Sep 01 00:23:32 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:33 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 1073741824" returned: 0 in 0.608s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:33 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 Sep 01 00:23:33 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:33 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589" returned: 0 in 0.353s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89faf4e3-23f3-4805-8710-dfe1785ad8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817c87bb-5703-4394-b755-f010be1e1589', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825da0d3-1264-43bf-9498-5a1a1e7099c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Volume volume-817c87bb-5703-4394-b755-f010be1e1589 (817c87bb-5703-4394-b755-f010be1e1589): created successfully Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825da0d3-1264-43bf-9498-5a1a1e7099c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (3b8cc095-d25c-4b34-b885-ff5ea64df7fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8d880da6-1d92-4ddc-afa9-36d95390ca8b tempest-VolumesListAdminTestJSON-2120919161 None] Created volume successfully. Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (8e6de364-4e84-4595-be5e-ebe61a2fbbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56660486-3ac0-43dc-b39d-6daedfc39848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56660486-3ac0-43dc-b39d-6daedfc39848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176554962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fc8482-eabd-4433-8e62-c291affc44a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:36Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea751b9-9955-4803-8455-3bf5d37a86ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea751b9-9955-4803-8455-3bf5d37a86ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a512069c-5305-493c-8fe5-91f55613c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a512069c-5305-493c-8fe5-91f55613c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fc8482-eabd-4433-8e62-c291affc44a0', 'volume_name': 'volume-70fc8482-eabd-4433-8e62-c291affc44a0', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdeee91-5322-42bc-8c76-6194fe9c3be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdeee91-5322-42bc-8c76-6194fe9c3be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceecaa6f-5ea5-4c65-bc78-0f0fc997dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:35 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Volume 70fc8482-eabd-4433-8e62-c291affc44a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fc8482-eabd-4433-8e62-c291affc44a0', 'volume_size': 1} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176554962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fc8482-eabd-4433-8e62-c291affc44a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b4bc7244124492a68ba4487e72e2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:36Z,use_quota=True,user_id='35015ab940554b009e35b2686da8fec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Creating volume 70fc8482-eabd-4433-8e62-c291affc44a0 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:35 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 1073741824 Sep 01 00:23:35 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:36 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 1073741824" returned: 0 in 0.612s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:36 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 Sep 01 00:23:36 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:36 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceecaa6f-5ea5-4c65-bc78-0f0fc997dda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fc8482-eabd-4433-8e62-c291affc44a0', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4614be-b4a9-4311-9cde-1c544479a920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Volume volume-70fc8482-eabd-4433-8e62-c291affc44a0 (70fc8482-eabd-4433-8e62-c291affc44a0): created successfully Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4614be-b4a9-4311-9cde-1c544479a920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Flow 'volume_create_manager' (8e6de364-4e84-4595-be5e-ebe61a2fbbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7a5b8a40-1ee9-4bf8-abad-7af8b798d47a tempest-VolumesListAdminTestJSON-2120919161 None] Created volume successfully. Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Flow 'volume_create_manager' (e6df7c50-3bc1-452c-bfe2-aeefa2e186d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f44d38-4ac8-462d-953c-776503c59d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f44d38-4ac8-462d-953c-776503c59d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209948d7-427d-4ca5-b105-4f75d5bebf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8bac6db2594576a9ec84ba61fd9d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:39Z,use_quota=True,user_id='b58d0637973048aab25bc95cbee300be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752d9d68-05ca-4f4a-89da-f565d331a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752d9d68-05ca-4f4a-89da-f565d331a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27604731-b814-43b0-87f3-4937564ec840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27604731-b814-43b0-87f3-4937564ec840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209948d7-427d-4ca5-b105-4f75d5bebf27', 'volume_name': 'volume-209948d7-427d-4ca5-b105-4f75d5bebf27', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b0a65-7389-4622-9544-bde1c63f23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b0a65-7389-4622-9544-bde1c63f23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd07e-bb38-4520-aea1-53014218fbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Volume 209948d7-427d-4ca5-b105-4f75d5bebf27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209948d7-427d-4ca5-b105-4f75d5bebf27', 'volume_size': 1} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209948d7-427d-4ca5-b105-4f75d5bebf27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d8bac6db2594576a9ec84ba61fd9d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:39Z,use_quota=True,user_id='b58d0637973048aab25bc95cbee300be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Creating volume 209948d7-427d-4ca5-b105-4f75d5bebf27 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:38 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:38 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 1073741824 Sep 01 00:23:38 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:39 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 1073741824" returned: 0 in 0.678s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-717a830e-b0ea-4edc-8dad-7662784a692d req-0df501e2-28b1-47b9-a8fe-b174a26a498a tempest-AttachVolumeNegativeTest-1698104254 None] Terminate volume connection completed successfully. Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-717a830e-b0ea-4edc-8dad-7662784a692d req-0df501e2-28b1-47b9-a8fe-b174a26a498a tempest-AttachVolumeNegativeTest-1698104254 None] Deleting attachment 40b21ae0-9f28-4a18-be03-6d6e80181a62. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:39 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 Sep 01 00:23:39 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:39 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27" returned: 0 in 0.387s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd07e-bb38-4520-aea1-53014218fbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209948d7-427d-4ca5-b105-4f75d5bebf27', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75f443-a242-41c6-b0ed-b4eb13608bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Volume volume-209948d7-427d-4ca5-b105-4f75d5bebf27 (209948d7-427d-4ca5-b105-4f75d5bebf27): created successfully Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf75f443-a242-41c6-b0ed-b4eb13608bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Flow 'volume_create_manager' (e6df7c50-3bc1-452c-bfe2-aeefa2e186d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3d158235-1515-40ff-9e58-8d1b00d1ef7a tempest-VolumesListAdminTestJSON-785066338 None] Created volume successfully. Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Acquiring lock "cinder-209948d7-427d-4ca5-b105-4f75d5bebf27-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "cinder-209948d7-427d-4ca5-b105-4f75d5bebf27-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Acquiring lock "cinder-quobyte-209948d7-427d-4ca5-b105-4f75d5bebf27" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "cinder-quobyte-209948d7-427d-4ca5-b105-4f75d5bebf27" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a73e6b-97a2-4533-9013-2c540d0ccf32]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-70fc8482-eabd-4433-8e62-c291affc44a0-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-70fc8482-eabd-4433-8e62-c291affc44a0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-quobyte-70fc8482-eabd-4433-8e62-c291affc44a0" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-70fc8482-eabd-4433-8e62-c291affc44a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:41 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 Sep 01 00:23:41 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d48f35-0b0a-459d-983d-dd9ef6d05ef2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:41 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 Sep 01 00:23:41 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:41 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27" returned: 0 in 0.594s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:41 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27 Sep 01 00:23:41 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:42 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0" returned: 0 in 0.551s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:42 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0 Sep 01 00:23:42 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:42 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-209948d7-427d-4ca5-b105-4f75d5bebf27" returned: 0 in 0.556s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "cinder-quobyte-209948d7-427d-4ca5-b105-4f75d5bebf27" released by "delete_volume" :: held 1.216s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Created reservations ['3564bfaa-8073-413b-8bb5-b2481b6079ee', 'a64794b1-0311-4937-8ac6-7dcb1ae15b90', 'ff21c636-fc40-49af-8ddf-0228e74cb042', '8173c280-59a7-4b4d-9de2-465bb8abb1d8'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:42 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-70fc8482-eabd-4433-8e62-c291affc44a0" returned: 0 in 0.545s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-70fc8482-eabd-4433-8e62-c291affc44a0" released by "delete_volume" :: held 1.155s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:42 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:42 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Created reservations ['74f9b090-1236-40db-bea6-5829c50aea51', '13a0bbd0-222b-4349-950f-b68f50220fa0', '48516186-6f76-4a74-af47-44f02e1fdcf6', 'b90433f2-5969-425b-b075-6fff5a256a2a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:42 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:42 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:42 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.307s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Deleted volume successfully. Sep 01 00:23:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-98bb0578-faf7-430a-a349-438d824efad0 tempest-VolumesListAdminTestJSON-785066338 None] Lock "cinder-209948d7-427d-4ca5-b105-4f75d5bebf27-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:43 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Deleted volume successfully. Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a2828b55-cdb3-48c8-998f-9adf3167bb99 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-70fc8482-eabd-4433-8e62-c291affc44a0-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-817c87bb-5703-4394-b755-f010be1e1589-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-817c87bb-5703-4394-b755-f010be1e1589-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-quobyte-817c87bb-5703-4394-b755-f010be1e1589" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-817c87bb-5703-4394-b755-f010be1e1589" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc11bf-53cd-48df-a0ee-32f6eef7b971]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:44 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 Sep 01 00:23:44 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:44 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589" returned: 0 in 0.555s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:44 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589 Sep 01 00:23:44 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:44 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-817c87bb-5703-4394-b755-f010be1e1589" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-817c87bb-5703-4394-b755-f010be1e1589" released by "delete_volume" :: held 0.930s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Created reservations ['927d9249-367a-4877-9ae6-cbb483a8cfbb', '98fbee5b-7781-426a-92d8-e507b426f0e9', '4f999a66-84c1-4e3f-a9f3-a77e9dfd7c5f', '2d3ef54a-9ccb-4915-893f-c33c916e49a4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:45 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:45 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-49eaf840-6805-4e15-a063-179d0282311b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-49eaf840-6805-4e15-a063-179d0282311b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "cinder-quobyte-49eaf840-6805-4e15-a063-179d0282311b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-49eaf840-6805-4e15-a063-179d0282311b" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f5ece-92a7-4764-8768-89a556c1f210]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:45 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Deleted volume successfully. Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74e903b2-e48f-4a2c-a9aa-15a660f56f81 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-817c87bb-5703-4394-b755-f010be1e1589-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:45 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b Sep 01 00:23:45 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:45 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b" returned: 0 in 0.479s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:45 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b Sep 01 00:23:45 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:46 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-49eaf840-6805-4e15-a063-179d0282311b" returned: 0 in 0.348s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-quobyte-49eaf840-6805-4e15-a063-179d0282311b" released by "delete_volume" :: held 0.882s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Created reservations ['e80a9210-2ec1-4ffe-acc1-57a17de063c4', '1a39f4c8-3478-42b8-821a-b8687f845204', 'cd205c98-ae92-4882-8f7d-5c1143fd0504', '9654a1a6-0c03-4b98-b68e-9cc8c19122ac'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:46 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:23:46 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:46 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.282s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:23:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Deleted volume successfully. Sep 01 00:23:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-464c2785-717c-4054-9e17-18eee29fc2e5 tempest-VolumesListAdminTestJSON-2120919161 None] Lock "cinder-49eaf840-6805-4e15-a063-179d0282311b-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (08fc48b0-3d62-4b04-b557-9b2c3b169c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d12e648-93f0-4aa8-a257-ac4e2024ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d12e648-93f0-4aa8-a257-ac4e2024ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1917127968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0212a3e7-347e-438d-90d6-6bc1f031a89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:54Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47fca245-0498-4e7c-8a84-7ac521814259),volume_type_id=47fca245-0498-4e7c-8a84-7ac521814259)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd89a69-2e4a-4911-8fd8-33d5fe62feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd89a69-2e4a-4911-8fd8-33d5fe62feab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9f9efc-8af0-4590-b06a-b5bfae0ccf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9f9efc-8af0-4590-b06a-b5bfae0ccf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0212a3e7-347e-438d-90d6-6bc1f031a89b', 'volume_name': 'volume-0212a3e7-347e-438d-90d6-6bc1f031a89b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81569dfc-5c6f-42c1-b59f-ef74dea5b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81569dfc-5c6f-42c1-b59f-ef74dea5b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e757416a-f8a3-42bb-8295-584f06cb3e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume 0212a3e7-347e-438d-90d6-6bc1f031a89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0212a3e7-347e-438d-90d6-6bc1f031a89b', 'volume_size': 1} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1917127968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0212a3e7-347e-438d-90d6-6bc1f031a89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:54Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47fca245-0498-4e7c-8a84-7ac521814259),volume_type_id=47fca245-0498-4e7c-8a84-7ac521814259)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Creating volume 0212a3e7-347e-438d-90d6-6bc1f031a89b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:54 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b 1073741824 Sep 01 00:23:54 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (f91378f1-f212-4e80-bc56-2addd15e8f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4f76af-205b-4560-9aa5-e396c1b39e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4f76af-205b-4560-9aa5-e396c1b39e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-466532256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968cb1b8-a3a0-4dac-8095-ecb0f6928ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:55Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ad8bb74-9807-4609-a093-036db93b9919),volume_type_id=5ad8bb74-9807-4609-a093-036db93b9919)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed28af0-8514-45e8-b0ac-2c51d5858e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed28af0-8514-45e8-b0ac-2c51d5858e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243be263-a917-4e5e-9f5e-9bb36c6d5871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243be263-a917-4e5e-9f5e-9bb36c6d5871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968cb1b8-a3a0-4dac-8095-ecb0f6928ef5', 'volume_name': 'volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081fbdfd-c42c-469c-a620-7bcfc9878738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081fbdfd-c42c-469c-a620-7bcfc9878738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ce16e6-9012-4b71-9cfb-79929aad10d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume 968cb1b8-a3a0-4dac-8095-ecb0f6928ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5', 'volume_size': 1} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:55 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b 1073741824" returned: 0 in 0.770s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:55 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b Sep 01 00:23:55 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:55 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b" returned: 0 in 0.501s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-466532256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968cb1b8-a3a0-4dac-8095-ecb0f6928ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:55Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ad8bb74-9807-4609-a093-036db93b9919),volume_type_id=5ad8bb74-9807-4609-a093-036db93b9919)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Creating volume 968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:23:55 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e757416a-f8a3-42bb-8295-584f06cb3e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0212a3e7-347e-438d-90d6-6bc1f031a89b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa8d1cd-e871-4357-ae5d-3304bc6078a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:55 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 1073741824 Sep 01 00:23:55 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume volume-0212a3e7-347e-438d-90d6-6bc1f031a89b (0212a3e7-347e-438d-90d6-6bc1f031a89b): created successfully Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa8d1cd-e871-4357-ae5d-3304bc6078a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (08fc48b0-3d62-4b04-b557-9b2c3b169c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5838c9a1-3bee-4acb-a1be-e1d76fa3564d tempest-TestInstancesWithCinderVolumes-1564614376 None] Created volume successfully. Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (46f6934a-15da-43f2-8b65-09ae7029d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be478b7b-1f8e-4dc9-a2cb-c3ff35ec9593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be478b7b-1f8e-4dc9-a2cb-c3ff35ec9593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1184810937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060bf6ab-d725-41dd-870c-96308272ade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:56Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dfc9708-7fa7-45ab-aa8f-e3a3b4f76250),volume_type_id=4dfc9708-7fa7-45ab-aa8f-e3a3b4f76250)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fb33ea-c173-45d4-b6f5-5299610c604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fb33ea-c173-45d4-b6f5-5299610c604c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52be6767-4313-4b18-bbca-c1e78d2d77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:23:56 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 1073741824" returned: 0 in 0.809s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:23:56 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 Sep 01 00:23:56 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52be6767-4313-4b18-bbca-c1e78d2d77dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '060bf6ab-d725-41dd-870c-96308272ade5', 'volume_name': 'volume-060bf6ab-d725-41dd-870c-96308272ade5', 'volume_size': 1, 'image_id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1100301027', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdb1d971df734d69a76b73dad97f2f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'created_at': datetime.datetime(2026, 8, 31, 22, 23, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df43999e-ed8e-49b3-947e-524e6b96fef8/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4646cee7-83bb-4eda-8dd9-4ff5de0bb370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4646cee7-83bb-4eda-8dd9-4ff5de0bb370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f29c3e-50f5-4d2e-b973-a6688c483e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume 060bf6ab-d725-41dd-870c-96308272ade5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-060bf6ab-d725-41dd-870c-96308272ade5', 'volume_size': 1, 'image_id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1100301027', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdb1d971df734d69a76b73dad97f2f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'created_at': datetime.datetime(2026, 8, 31, 22, 23, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df43999e-ed8e-49b3-947e-524e6b96fef8/file', 'properties': {}}, 'image_service': } Sep 01 00:23:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Trying to clone 060bf6ab-d725-41dd-870c-96308272ade5 from image df43999e-ed8e-49b3-947e-524e6b96fef8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:23:57 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" returned: 0 in 0.392s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ce16e6-9012-4b71-9cfb-79929aad10d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5c0d5f-b66b-44ad-8f2c-94a76474fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:23:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 (968cb1b8-a3a0-4dac-8095-ecb0f6928ef5): created successfully Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5c0d5f-b66b-44ad-8f2c-94a76474fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:23:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (f91378f1-f212-4e80-bc56-2addd15e8f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:23:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c9fc640-9bd4-49dd-a5d9-7ae5e1f6e740 tempest-TestInstancesWithCinderVolumes-1564614376 None] Created volume successfully. Sep 01 00:24:01 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD, size 20.69 MB, duration 4.57 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:24:01 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Image download 20.69 MB at 4.52 MB/s Sep 01 00:24:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc34f19-602c-4fbb-88d4-a3be395af476]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:01 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD Sep 01 00:24:01 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:02 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Temporary image df43999e-ed8e-49b3-947e-524e6b96fef8 is fetched for user b8fb99e3d2414bb1ac3a40e431815a34. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6c1c7-07d8-41da-8577-140d4a5cfcda]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:02 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD Sep 01 00:24:02 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:02 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1184810937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060bf6ab-d725-41dd-870c-96308272ade5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb1d971df734d69a76b73dad97f2f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:23:56Z,use_quota=True,user_id='b8fb99e3d2414bb1ac3a40e431815a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4dfc9708-7fa7-45ab-aa8f-e3a3b4f76250),volume_type_id=4dfc9708-7fa7-45ab-aa8f-e3a3b4f76250)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Creating volume 060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:02 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:02 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1073741824 Sep 01 00:24:02 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:03 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1073741824" returned: 0 in 0.661s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:03 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 Sep 01 00:24:03 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:03 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5" returned: 0 in 0.278s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Attempting download of df43999e-ed8e-49b3-947e-524e6b96fef8 ((None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}])) to volume 060bf6ab-d725-41dd-870c-96308272ade5. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158b193-c1be-4d55-91c6-cae1af923b25]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:03 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc Sep 01 00:24:03 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:04 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc" returned: 0 in 0.366s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:04 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc Sep 01 00:24:04 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:04 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc" returned: 1 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df43999e-ed8e-49b3-947e-524e6b96fef8_bz5aedkc' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b5e09-eee7-4a32-b64a-8d310942dfb5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:04 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD Sep 01 00:24:04 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:04 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] df43999e-ed8e-49b3-947e-524e6b96fef8 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:24:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:04 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 Sep 01 00:24:04 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:07 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5" returned: 0 in 2.166s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df43999e-ed8e-49b3-947e-524e6b96fef8_d2olmmh8devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:24:07 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Converted 112.00 MB image at 51.67 MB/s Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:07 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1G Sep 01 00:24:07 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:07 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 1G" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Downloaded image df43999e-ed8e-49b3-947e-524e6b96fef8 ((None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}])) to volume 060bf6ab-d725-41dd-870c-96308272ade5 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Temporary image df43999e-ed8e-49b3-947e-524e6b96fef8 for user b8fb99e3d2414bb1ac3a40e431815a34 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Marking volume 060bf6ab-d725-41dd-870c-96308272ade5 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=85,cinder:UPDATE=119,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Copying metadata from image df43999e-ed8e-49b3-947e-524e6b96fef8 to 060bf6ab-d725-41dd-870c-96308272ade5. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Creating volume glance metadata for volume 060bf6ab-d725-41dd-870c-96308272ade5 backed by image df43999e-ed8e-49b3-947e-524e6b96fef8 with: {'image_id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'image_name': 'tempest-scenario-img--1100301027', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=86,cinder:DELETE=10,cinder:INSERT=28,cinder:UPDATE=111 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f29c3e-50f5-4d2e-b973-a6688c483e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060bf6ab-d725-41dd-870c-96308272ade5', 'volume_size': 1, 'image_id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df43999e-ed8e-49b3-947e-524e6b96fef8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1100301027', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fdb1d971df734d69a76b73dad97f2f99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df43999e-ed8e-49b3-947e-524e6b96fef8', 'created_at': datetime.datetime(2026, 8, 31, 22, 23, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 23, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df43999e-ed8e-49b3-947e-524e6b96fef8/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a114f0f-7a78-45dc-bedd-3cf8ea88fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Volume volume-060bf6ab-d725-41dd-870c-96308272ade5 (060bf6ab-d725-41dd-870c-96308272ade5): created successfully Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a114f0f-7a78-45dc-bedd-3cf8ea88fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Flow 'volume_create_manager' (46f6934a-15da-43f2-8b65-09ae7029d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-877599ee-b067-40fb-bc7f-7b068c7f8bba tempest-TestInstancesWithCinderVolumes-1564614376 None] Created volume successfully. Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:13 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:24:13 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:14 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.530s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:24:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:24:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:24:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:24:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-080f176f-cfa4-43b6-9e33-ef6aa6d20fcd req-94b28274-4d28-44b6-8d7d-0db3ad9c9d64 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-080f176f-cfa4-43b6-9e33-ef6aa6d20fcd req-94b28274-4d28-44b6-8d7d-0db3ad9c9d64 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-080f176f-cfa4-43b6-9e33-ef6aa6d20fcd req-94b28274-4d28-44b6-8d7d-0db3ad9c9d64 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-080f176f-cfa4-43b6-9e33-ef6aa6d20fcd req-94b28274-4d28-44b6-8d7d-0db3ad9c9d64 tempest-TestInstancesWithCinderVolumes-1564614376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-060bf6ab-d725-41dd-870c-96308272ade5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96aa2db2-d82f-4dc5-b4e2-2ca42f9dc62f', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:24:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-080f176f-cfa4-43b6-9e33-ef6aa6d20fcd req-94b28274-4d28-44b6-8d7d-0db3ad9c9d64 tempest-TestInstancesWithCinderVolumes-1564614376 None] attachment_update completed successfully. Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Flow 'volume_create_manager' (1fd3fabb-8c6f-43cb-b174-9126205019a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23da6650-9d33-4b87-9e76-7f0050c3cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23da6650-9d33-4b87-9e76-7f0050c3cde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1654683631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87e5d1a-b38a-48b1-bb44-73b774f39173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d7ea84c534441a9582e1966e99536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:22Z,use_quota=True,user_id='f33ea19ffe1b4e8691056c7c6e1615af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f5ae7f-6ae4-4d60-9ea8-ee1c619eb8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f5ae7f-6ae4-4d60-9ea8-ee1c619eb8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03935c6b-b636-498e-ba8b-e7d8f5d4a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03935c6b-b636-498e-ba8b-e7d8f5d4a692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87e5d1a-b38a-48b1-bb44-73b774f39173', 'volume_name': 'volume-e87e5d1a-b38a-48b1-bb44-73b774f39173', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca1652-21df-428d-9888-c3ecc6d3c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca1652-21df-428d-9888-c3ecc6d3c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904af7b2-a537-4b54-a8bc-7d0e36d8889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Volume e87e5d1a-b38a-48b1-bb44-73b774f39173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87e5d1a-b38a-48b1-bb44-73b774f39173', 'volume_size': 1} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1654683631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87e5d1a-b38a-48b1-bb44-73b774f39173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80d7ea84c534441a9582e1966e99536c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:22Z,use_quota=True,user_id='f33ea19ffe1b4e8691056c7c6e1615af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Creating volume e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:22 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:22 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 1073741824 Sep 01 00:24:22 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:23 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 1073741824" returned: 0 in 0.632s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:23 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:24:23 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:23 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.459s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904af7b2-a537-4b54-a8bc-7d0e36d8889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87e5d1a-b38a-48b1-bb44-73b774f39173', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1818e35b-2e4e-4995-800b-027bcfe4abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:23 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Volume volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 (e87e5d1a-b38a-48b1-bb44-73b774f39173): created successfully Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1818e35b-2e4e-4995-800b-027bcfe4abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Flow 'volume_create_manager' (1fd3fabb-8c6f-43cb-b174-9126205019a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4627d9cb-f23d-487d-9ede-5de30709c221 tempest-VolumesActionsTest-581923956 None] Created volume successfully. Sep 01 00:24:33 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=7 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:24:33 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (135f9417-9a2f-4774-ba5c-355cf1e3012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b0898-0b61-4ec2-a11b-93936e268071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b0898-0b61-4ec2-a11b-93936e268071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143226398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ba45c-10c4-4b54-a732-8cb418eb02dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:36Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bde16e-8da5-4e9b-bfb7-b4d22a705146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bde16e-8da5-4e9b-bfb7-b4d22a705146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2cbf4c-cf72-4ee6-823a-e4e44cc34d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2cbf4c-cf72-4ee6-823a-e4e44cc34d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67ba45c-10c4-4b54-a732-8cb418eb02dd', 'volume_name': 'volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eadb59a-e3c5-4db7-96d9-72af6cf13c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eadb59a-e3c5-4db7-96d9-72af6cf13c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7136b3-28d9-44c9-904f-a69158f23499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Volume a67ba45c-10c4-4b54-a732-8cb418eb02dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd', 'volume_size': 1} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-143226398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ba45c-10c4-4b54-a732-8cb418eb02dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:36Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Creating volume a67ba45c-10c4-4b54-a732-8cb418eb02dd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:36 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:36 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd 1073741824 Sep 01 00:24:36 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:37 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd 1073741824" returned: 0 in 1.840s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:38 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd Sep 01 00:24:38 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:38 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd" returned: 0 in 0.514s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] <== create_volume: return (2484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7136b3-28d9-44c9-904f-a69158f23499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361ccbd-ff56-445d-8843-f9aa7f1e6e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Volume volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd (a67ba45c-10c4-4b54-a732-8cb418eb02dd): created successfully Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361ccbd-ff56-445d-8843-f9aa7f1e6e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (135f9417-9a2f-4774-ba5c-355cf1e3012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4ed52c27-094c-423f-9ca6-ce149500de96 tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:24:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-620d69df-6f6e-459c-8b0f-7934184742bd tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd" by "attach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-620d69df-6f6e-459c-8b0f-7934184742bd tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd" acquired by "attach_volume" :: waited 0.068s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-620d69df-6f6e-459c-8b0f-7934184742bd tempest-VolumesActionsTest-64441313 None] Attaching volume a67ba45c-10c4-4b54-a732-8cb418eb02dd to instance 090d8ea1-e5bd-47da-adf5-c3cfcdf04dff at mountpoint /dev/vdb on host None. Sep 01 00:24:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-620d69df-6f6e-459c-8b0f-7934184742bd tempest-VolumesActionsTest-64441313 None] Attach volume completed successfully. Sep 01 00:24:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-620d69df-6f6e-459c-8b0f-7934184742bd tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd" released by "attach_volume" :: held 0.349s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Terminate volume connection completed successfully. Sep 01 00:24:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" by "detach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Detaching volume a67ba45c-10c4-4b54-a732-8cb418eb02dd from instance 090d8ea1-e5bd-47da-adf5-c3cfcdf04dff. Sep 01 00:24:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Detach volume completed successfully. Sep 01 00:24:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4b584616-7e66-401c-ab65-39f4801c7daf tempest-VolumesActionsTest-803865560 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-be8932a9-c254-42a5-b527-f81931e65ca8 tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" by "detach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-be8932a9-c254-42a5-b527-f81931e65ca8 tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-be8932a9-c254-42a5-b527-f81931e65ca8 tempest-VolumesActionsTest-64441313 None] Volume detach called, but volume not attached. Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-be8932a9-c254-42a5-b527-f81931e65ca8 tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-57a541e2-a5f1-4f0c-ad75-4fe39df29bd7 tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" by "attach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-57a541e2-a5f1-4f0c-ad75-4fe39df29bd7 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" acquired by "attach_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-57a541e2-a5f1-4f0c-ad75-4fe39df29bd7 tempest-VolumesActionsTest-581923956 None] Attaching volume e87e5d1a-b38a-48b1-bb44-73b774f39173 to instance f7ebff9a-ce1d-48e8-bd4c-e841b14a9d3d at mountpoint /dev/vdb on host None. Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-quobyte-a67ba45c-10c4-4b54-a732-8cb418eb02dd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "cinder-quobyte-a67ba45c-10c4-4b54-a732-8cb418eb02dd" acquired by "delete_volume" :: waited 0.044s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-57a541e2-a5f1-4f0c-ad75-4fe39df29bd7 tempest-VolumesActionsTest-581923956 None] Attach volume completed successfully. Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-57a541e2-a5f1-4f0c-ad75-4fe39df29bd7 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" released by "attach_volume" :: held 0.294s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[68913b6a-2bdc-4e3c-866d-a9f68f1951aa]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-63b2eebf-efed-4311-903e-8f8c1761c88c tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" by "detach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:42 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd Sep 01 00:24:42 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-63b2eebf-efed-4311-903e-8f8c1761c88c tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-63b2eebf-efed-4311-903e-8f8c1761c88c tempest-VolumesActionsTest-581923956 None] Detaching volume e87e5d1a-b38a-48b1-bb44-73b774f39173 from instance f7ebff9a-ce1d-48e8-bd4c-e841b14a9d3d. Sep 01 00:24:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-63b2eebf-efed-4311-903e-8f8c1761c88c tempest-VolumesActionsTest-581923956 None] Detach volume completed successfully. Sep 01 00:24:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-63b2eebf-efed-4311-903e-8f8c1761c88c tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:42 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd" returned: 0 in 0.831s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:42 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd Sep 01 00:24:42 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:43 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a67ba45c-10c4-4b54-a732-8cb418eb02dd" returned: 0 in 0.960s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "cinder-quobyte-a67ba45c-10c4-4b54-a732-8cb418eb02dd" released by "delete_volume" :: held 1.953s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (2f8f2674-3e0c-4614-9026-eb9e9573e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48ed856-a1d0-4fd3-9d17-17832c64ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48ed856-a1d0-4fd3-9d17-17832c64ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-336966375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed14f95-9c16-462e-aa7c-2e0da2777cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:44Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22917185-5def-480b-ac04-92d61f20e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22917185-5def-480b-ac04-92d61f20e163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508e04ac-bb74-4942-963c-81b767db14a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508e04ac-bb74-4942-963c-81b767db14a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed14f95-9c16-462e-aa7c-2e0da2777cdd', 'volume_name': 'volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c54dcc-d725-43bf-bbb1-52d45b1b7994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c54dcc-d725-43bf-bbb1-52d45b1b7994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba75e76e-ba39-471e-a7e0-852e139e632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Volume 8ed14f95-9c16-462e-aa7c-2e0da2777cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd', 'volume_size': 1} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-336966375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed14f95-9c16-462e-aa7c-2e0da2777cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:44Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Creating volume 8ed14f95-9c16-462e-aa7c-2e0da2777cdd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:44 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:44 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd 1073741824 Sep 01 00:24:44 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Created reservations ['606f25c1-4524-49f9-ad4d-b3a95fccfee4', '236df703-52b2-421f-aea4-1ba1c172a4f5', '889193f6-3f23-4e26-ae63-60a8aeb90081', '836ae634-39d4-4f2c-8707-e484050c378a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:44 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:24:44 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:45 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd 1073741824" returned: 0 in 0.938s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:45 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd Sep 01 00:24:45 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:45 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.667s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:24:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Deleted volume successfully. Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6655e258-a977-4df6-9a43-5c734055347e tempest-VolumesActionsTest-64441313 None] Lock "cinder-a67ba45c-10c4-4b54-a732-8cb418eb02dd-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:45 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" returned: 0 in 0.633s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba75e76e-ba39-471e-a7e0-852e139e632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d535b1bf-d27d-4265-8d47-2661621228bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:45 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Volume volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd (8ed14f95-9c16-462e-aa7c-2e0da2777cdd): created successfully Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d535b1bf-d27d-4265-8d47-2661621228bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (2f8f2674-3e0c-4614-9026-eb9e9573e864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0807a78c-5c6b-4a66-a889-56189a67093c tempest-AttachVolumeNegativeTest-1698104254 None] Created volume successfully. Sep 01 00:24:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6189b533-4c2c-4f97-8504-d32d80b4157a req-dac8c404-a2ac-4e17-9554-90a9f3d09d38 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6189b533-4c2c-4f97-8504-d32d80b4157a req-dac8c404-a2ac-4e17-9554-90a9f3d09d38 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-6189b533-4c2c-4f97-8504-d32d80b4157a req-dac8c404-a2ac-4e17-9554-90a9f3d09d38 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-6189b533-4c2c-4f97-8504-d32d80b4157a req-dac8c404-a2ac-4e17-9554-90a9f3d09d38 tempest-AttachVolumeNegativeTest-1698104254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1eeb14d-86f1-4e21-b7ad-99d3a3a5e6dd', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:24:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-6189b533-4c2c-4f97-8504-d32d80b4157a req-dac8c404-a2ac-4e17-9554-90a9f3d09d38 tempest-AttachVolumeNegativeTest-1698104254 None] attachment_update completed successfully. Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (1aac9649-3542-465b-af3e-544fe432290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e05a1a-4469-4ea1-8b27-eb2fdc444e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e05a1a-4469-4ea1-8b27-eb2fdc444e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1582836732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd31b5-5c5a-47a3-abe3-d7c7ee582542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:50Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbc3070-067e-4e67-bd6b-3d38c3ddb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbc3070-067e-4e67-bd6b-3d38c3ddb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36092c-68c3-4b40-9c21-389d10167e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36092c-68c3-4b40-9c21-389d10167e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcd31b5-5c5a-47a3-abe3-d7c7ee582542', 'volume_name': 'volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d4c2ac-16ea-4171-9174-90729c06a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d4c2ac-16ea-4171-9174-90729c06a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38dbb24-871d-4182-a6a7-a797bf81499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:49 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Volume 4bcd31b5-5c5a-47a3-abe3-d7c7ee582542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542', 'volume_size': 1} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1582836732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd31b5-5c5a-47a3-abe3-d7c7ee582542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:50Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Creating volume 4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:49 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:49 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 1073741824 Sep 01 00:24:49 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:50 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 1073741824" returned: 0 in 0.878s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:50 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 Sep 01 00:24:50 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:51 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38dbb24-871d-4182-a6a7-a797bf81499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23521750-3717-464c-a89a-3e587c96da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:51 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Volume volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 (4bcd31b5-5c5a-47a3-abe3-d7c7ee582542): created successfully Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23521750-3717-464c-a89a-3e587c96da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (1aac9649-3542-465b-af3e-544fe432290d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a8b4bc42-2249-45ed-b120-214c77b6dbaf tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:24:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-c4519c0d-ff68-499a-868e-b8969e2cf844 req-1ae8d079-8c74-47b6-8d0d-4c5d75f6934c tempest-AttachVolumeNegativeTest-1698104254 None] Terminate volume connection completed successfully. Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-c4519c0d-ff68-499a-868e-b8969e2cf844 req-1ae8d079-8c74-47b6-8d0d-4c5d75f6934c tempest-AttachVolumeNegativeTest-1698104254 None] Deleting attachment a1eeb14d-86f1-4e21-b7ad-99d3a3a5e6dd. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "cinder-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-quobyte-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846d095-b4ce-4bb6-8219-122a4ac69a59]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:52 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 Sep 01 00:24:52 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:52 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" returned: 0 in 0.571s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:52 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542 Sep 01 00:24:52 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:53 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" returned: 0 in 0.341s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542" released by "delete_volume" :: held 0.971s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Created reservations ['a57bfc2a-9a44-46bf-bfb2-9367296fe357', '520537e0-d99f-44b4-ae3d-07b0cdd3e6c6', 'f96b38d5-f8b5-4035-8f09-0ccaee096c62', '284c9eea-58fc-4cf4-8723-2bcd6363dde4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:53 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:24:53 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:53 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.341s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:24:53 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Deleted volume successfully. Sep 01 00:24:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-627ea99c-cdf5-4727-8a9a-b51dfb8319ca tempest-VolumesActionsTest-803865560 None] Lock "cinder-4bcd31b5-5c5a-47a3-abe3-d7c7ee582542-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (3a22731e-f0f2-47ce-98bd-8446053d18c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c520a57-328a-4ac5-98ef-63346cd094de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c520a57-328a-4ac5-98ef-63346cd094de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504275160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:55Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ee678-7515-47b6-b015-ef076a82a07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2ee678-7515-47b6-b015-ef076a82a07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df2d746-707b-481b-b1d8-f6e494172453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df2d746-707b-481b-b1d8-f6e494172453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd', 'volume_name': 'volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42a0ad6-4226-4a03-9d20-9431804ff0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42a0ad6-4226-4a03-9d20-9431804ff0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d072c07-7c3e-492a-b5d6-ccf1ee04f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Volume 4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd', 'volume_size': 1} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504275160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:24:55Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Creating volume 4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:24:55 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:24:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:55 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd 1073741824 Sep 01 00:24:55 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:56 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd 1073741824" returned: 0 in 0.990s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:56 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd Sep 01 00:24:56 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:56 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" returned: 0 in 0.394s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d072c07-7c3e-492a-b5d6-ccf1ee04f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89b86b-4c44-4181-96bf-a184bf7c446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c921d947-82e9-4eb0-8eff-51b8946304e5 tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" by "attach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Volume volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd (4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd): created successfully Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec89b86b-4c44-4181-96bf-a184bf7c446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (3a22731e-f0f2-47ce-98bd-8446053d18c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:24:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c921d947-82e9-4eb0-8eff-51b8946304e5 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" acquired by "attach_volume" :: waited 0.057s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d0f3aef7-12d6-47dd-824d-bb196cc8dbc6 tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:24:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c921d947-82e9-4eb0-8eff-51b8946304e5 tempest-VolumesActionsTest-581923956 None] Attaching volume e87e5d1a-b38a-48b1-bb44-73b774f39173 to instance 6fb92af7-721f-429a-b77c-526a45df3110 at mountpoint /dev/vdb on host None. Sep 01 00:24:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c921d947-82e9-4eb0-8eff-51b8946304e5 tempest-VolumesActionsTest-581923956 None] Attach volume completed successfully. Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c921d947-82e9-4eb0-8eff-51b8946304e5 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173" released by "attach_volume" :: held 0.117s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4d0bd7ed-3e15-4cf7-8baa-f7cb41025980 tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" by "detach_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4d0bd7ed-3e15-4cf7-8baa-f7cb41025980 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4d0bd7ed-3e15-4cf7-8baa-f7cb41025980 tempest-VolumesActionsTest-581923956 None] Detaching volume e87e5d1a-b38a-48b1-bb44-73b774f39173 from instance 6fb92af7-721f-429a-b77c-526a45df3110. Sep 01 00:24:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4d0bd7ed-3e15-4cf7-8baa-f7cb41025980 tempest-VolumesActionsTest-581923956 None] Detach volume completed successfully. Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4d0bd7ed-3e15-4cf7-8baa-f7cb41025980 tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "cinder-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-quobyte-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7667581-42f2-4acc-b7db-13e5851fb50f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:24:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:57 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd Sep 01 00:24:57 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:58 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" returned: 0 in 0.687s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:58 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd Sep 01 00:24:58 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:58 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd" released by "delete_volume" :: held 1.181s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:24:58 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Created reservations ['02fe9e82-465b-4acf-b380-b3821f711583', '269e690f-6aca-4fd0-9820-d39131468019', '7692cc08-5b8a-4e53-925d-1a679ff293e8', '191d011a-7520-4126-8655-2575cfd53f22'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:24:59 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:24:59 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:24:59 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:24:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Deleted volume successfully. Sep 01 00:24:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4934c63-af37-4ac9-859d-c0dbdf959e56 tempest-VolumesActionsTest-803865560 None] Lock "cinder-4d642d58-7b5b-4a0c-8b5d-514ddeee7ebd-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (f9a24dd0-e09b-4ca0-be5b-8f60636adc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851377c4-1de3-4c9b-8a68-2c44b6fec4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851377c4-1de3-4c9b-8a68-2c44b6fec4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071471139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06b347e-f068-4c0b-b517-4b7d2aadfcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:00Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057b2b92-f830-451f-a7de-925d9e9096f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057b2b92-f830-451f-a7de-925d9e9096f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f4bad0-4f62-407c-9d86-56f89773f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f4bad0-4f62-407c-9d86-56f89773f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06b347e-f068-4c0b-b517-4b7d2aadfcbc', 'volume_name': 'volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae28a40-18a7-4238-938b-e821eb8fde6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae28a40-18a7-4238-938b-e821eb8fde6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc8e3b-151b-4041-ae61-5155d3bba75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Volume e06b347e-f068-4c0b-b517-4b7d2aadfcbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc', 'volume_size': 1} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071471139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06b347e-f068-4c0b-b517-4b7d2aadfcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:00Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Creating volume e06b347e-f068-4c0b-b517-4b7d2aadfcbc {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:25:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:25:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:00 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc 1073741824 Sep 01 00:25:00 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:01 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc 1073741824" returned: 0 in 0.597s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:01 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc Sep 01 00:25:01 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:01 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbc8e3b-151b-4041-ae61-5155d3bba75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085dcb23-a2aa-44df-b3d7-f09fe69201fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:01 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Volume volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc (e06b347e-f068-4c0b-b517-4b7d2aadfcbc): created successfully Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085dcb23-a2aa-44df-b3d7-f09fe69201fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (f9a24dd0-e09b-4ca0-be5b-8f60636adc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-44eae552-5252-4a2a-9cc2-41c5f883aa87 tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-5aaa7dac-a4cc-4dcb-bca7-ee99f8033c9f req-548259e1-84b7-415e-ac06-8a84010f6873 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-5aaa7dac-a4cc-4dcb-bca7-ee99f8033c9f req-548259e1-84b7-415e-ac06-8a84010f6873 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-5aaa7dac-a4cc-4dcb-bca7-ee99f8033c9f req-548259e1-84b7-415e-ac06-8a84010f6873 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-5aaa7dac-a4cc-4dcb-bca7-ee99f8033c9f req-548259e1-84b7-415e-ac06-8a84010f6873 tempest-TestInstancesWithCinderVolumes-1564614376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-0212a3e7-347e-438d-90d6-6bc1f031a89b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e40e592c-192d-49fe-a1c1-49114880184e', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[89579f6d-e44b-4420-988c-c4badabefc27]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-5aaa7dac-a4cc-4dcb-bca7-ee99f8033c9f req-548259e1-84b7-415e-ac06-8a84010f6873 tempest-TestInstancesWithCinderVolumes-1564614376 None] attachment_update completed successfully. Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-e06b347e-f068-4c0b-b517-4b7d2aadfcbc-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:03 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:03 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "cinder-e06b347e-f068-4c0b-b517-4b7d2aadfcbc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-quobyte-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d54788-2c47-4cb9-bfd0-fdb08420741d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:03 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc Sep 01 00:25:03 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:03 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.626s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4504438c-aa0b-49eb-ac6d-903f7627a071]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:03 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:03 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:03 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" returned: 0 in 0.574s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:03 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc Sep 01 00:25:03 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:04 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.468s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.b7c65106-4743-458d-ba92-1199fa65e040mani6hfp.img {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:04 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.b7c65106-4743-458d-ba92-1199fa65e040mani6hfp.img Sep 01 00:25:04 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:04 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-e06b347e-f068-4c0b-b517-4b7d2aadfcbc" released by "delete_volume" :: held 0.942s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Created reservations ['ee2246fe-9b04-4e10-a775-3f16a4d4da24', 'b8b05b09-0e71-498e-ad10-0d736bd848ae', '4f2e4066-c64b-4ceb-96c0-f76356cc8b9c', 'c9d5a2d7-5568-4ba6-9138-ac125204680e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:04 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:04 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:05 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.673s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:05 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Deleted volume successfully. Sep 01 00:25:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d7538661-8a4b-4c38-b694-24d4af35e133 tempest-VolumesActionsTest-803865560 None] Lock "cinder-e06b347e-f068-4c0b-b517-4b7d2aadfcbc-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:06 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (bf4238d2-098b-40dc-997b-54597aee73b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3f1d22-500d-4962-b380-57f8afab6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3f1d22-500d-4962-b380-57f8afab6750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965411436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b10742c-55ca-4c57-89ef-73c1aec44b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:07Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2346782-8bfc-421d-b903-833c234b8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2346782-8bfc-421d-b903-833c234b8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7560810-bfa3-4ffa-b7ac-08ab2a8e9eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7560810-bfa3-4ffa-b7ac-08ab2a8e9eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b10742c-55ca-4c57-89ef-73c1aec44b3e', 'volume_name': 'volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ea30e2-ab3e-41bd-a16e-104ad9f5a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ea30e2-ab3e-41bd-a16e-104ad9f5a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c9d92f-2dd6-417b-91cf-c5b6281430a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Volume 2b10742c-55ca-4c57-89ef-73c1aec44b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e', 'volume_size': 1} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-76ccf2b3-c870-4522-851e-803217fec537 req-b78efccd-2b12-402a-a311-7df7546bf714 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:10 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.b7c65106-4743-458d-ba92-1199fa65e040mani6hfp.img" returned: 0 in 6.041s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18291ee-b8d5-4b86-bc79-46edb9e4f483]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:10 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:10 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:10 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.549s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.b7c65106-4743-458d-ba92-1199fa65e040mani6hfp.img {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:25:10 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Converted 1024.00 MB image at 169.47 MB/s Sep 01 00:25:10 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] b7c65106-4743-458d-ba92-1199fa65e040 was raw, no need to convert to raw {{(pid=87803) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:13 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:13 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:13 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:25:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:25:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:25:20 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=6,cinder:SELECT=64 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:25:20 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=73,cinder:UPDATE=64,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.211s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Uploaded volume to glance image-id: b7c65106-4743-458d-ba92-1199fa65e040. {{(pid=87803) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.941s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965411436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b10742c-55ca-4c57-89ef-73c1aec44b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:07Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Creating volume 2b10742c-55ca-4c57-89ef-73c1aec44b3e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:25:32 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f6dc56b3-a1e2-470f-a6b2-d7df01907ffb tempest-VolumesActionsTest-581923956 None] Copy volume to image completed successfully. Sep 01 00:25:32 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e 1073741824 Sep 01 00:25:32 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:32 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e 1073741824" returned: 0 in 0.467s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:32 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e Sep 01 00:25:32 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:32 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e" returned: 0 in 0.257s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-76ccf2b3-c870-4522-851e-803217fec537 req-b78efccd-2b12-402a-a311-7df7546bf714 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.211s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-76ccf2b3-c870-4522-851e-803217fec537 req-b78efccd-2b12-402a-a311-7df7546bf714 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c9d92f-2dd6-417b-91cf-c5b6281430a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f7281e-3a60-4b09-9812-59721fde7956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Volume volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e (2b10742c-55ca-4c57-89ef-73c1aec44b3e): created successfully Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f7281e-3a60-4b09-9812-59721fde7956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (bf4238d2-098b-40dc-997b-54597aee73b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-45bb1654-3089-404f-a2be-ad24e2cf62c2 tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:25:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-76ccf2b3-c870-4522-851e-803217fec537 req-b78efccd-2b12-402a-a311-7df7546bf714 tempest-TestInstancesWithCinderVolumes-1564614376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef648bed-0fe7-49d9-9557-62f7606da508', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:25:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-76ccf2b3-c870-4522-851e-803217fec537 req-b78efccd-2b12-402a-a311-7df7546bf714 tempest-TestInstancesWithCinderVolumes-1564614376 None] attachment_update completed successfully. Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-2b10742c-55ca-4c57-89ef-73c1aec44b3e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248afae-5411-40c0-8040-5c6fcb172f47]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "cinder-2b10742c-55ca-4c57-89ef-73c1aec44b3e-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Acquiring lock "cinder-quobyte-2b10742c-55ca-4c57-89ef-73c1aec44b3e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-2b10742c-55ca-4c57-89ef-73c1aec44b3e" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:33 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:33 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[36494383-499e-4fe0-a87a-7e9d565e1db6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:33 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e Sep 01 00:25:33 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:33 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.419s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035ae7d-a330-4170-afd7-7ee0710dbd77]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:33 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:33 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:33 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:34 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e Sep 01 00:25:34 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:34 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:34 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2b10742c-55ca-4c57-89ef-73c1aec44b3e" returned: 0 in 0.263s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "cinder-quobyte-2b10742c-55ca-4c57-89ef-73c1aec44b3e" released by "delete_volume" :: held 0.695s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:34 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img Sep 01 00:25:34 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Created reservations ['7d417a1a-f8a7-4142-8b46-96f218265ec2', '9e2c13f6-d5f9-4d24-93b0-ff1fb59d95d3', '318cb5a1-49fb-40bf-8a72-e2298fa22426', '17680202-3e42-4e91-acf8-eb7aef0ec60e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:34 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:34 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:34 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.285s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:34 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Deleted volume successfully. Sep 01 00:25:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5c4a9d4d-eb82-4506-acef-639b963949c1 tempest-VolumesActionsTest-803865560 None] Lock "cinder-2b10742c-55ca-4c57-89ef-73c1aec44b3e-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (91a967f0-46be-4b3e-a2fc-2cb4c05be81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45708024-8c8c-4370-86b3-1455586e9c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45708024-8c8c-4370-86b3-1455586e9c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406789494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a94b1f-ac46-42cc-a164-0001a5e10351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:36Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cf564e-51f2-4757-ac60-ecdfd2d9913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1cf564e-51f2-4757-ac60-ecdfd2d9913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc412a35-ce53-491d-a1f8-87d9780ebe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc412a35-ce53-491d-a1f8-87d9780ebe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a94b1f-ac46-42cc-a164-0001a5e10351', 'volume_name': 'volume-d2a94b1f-ac46-42cc-a164-0001a5e10351', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dee14d-b23e-4c9a-b01f-ef10254b125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00dee14d-b23e-4c9a-b01f-ef10254b125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bb019e-af09-4036-b593-0d91453ee8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Volume d2a94b1f-ac46-42cc-a164-0001a5e10351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a94b1f-ac46-42cc-a164-0001a5e10351', 'volume_size': 1} Sep 01 00:25:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (6b7b961d-4ec4-4b81-aa36-8462bf97f17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d1a35a-2010-4d3d-8378-b736851f120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d1a35a-2010-4d3d-8378-b736851f120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1034355262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5f132-8572-4c75-aa6e-59cdfd8f8247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:37Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65d90ae-c8a8-4ec6-82de-1be75b343f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65d90ae-c8a8-4ec6-82de-1be75b343f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadff8b5-8bf4-42f3-82e8-e657ba217be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadff8b5-8bf4-42f3-82e8-e657ba217be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c5f132-8572-4c75-aa6e-59cdfd8f8247', 'volume_name': 'volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2eab32-f945-479f-a6ff-c4aad36e4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2eab32-f945-479f-a6ff-c4aad36e4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77e70b3-a9bd-49d8-9aa0-afa5b6f08442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Volume 30c5f132-8572-4c75-aa6e-59cdfd8f8247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247', 'volume_size': 1} Sep 01 00:25:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:39 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img" returned: 0 in 5.222s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e656848-b512-4706-a468-bac97b255516]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:39 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:39 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:40 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.563s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:25:40 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Converted 1024.00 MB image at 196.05 MB/s Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] 4d1633e5-d161-464a-ab7f-8032127ebc61 was raw, converting to qcow2 {{(pid=87803) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[307326e2-eb01-4fea-9438-8b7c9b065073]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:40 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img Sep 01 00:25:40 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:40 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img" returned: 0 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-9e7a150d-4b97-4174-b0ef-06ef02385e53 req-d5379e4d-ef2e-4f61-bf64-417347b0d60e tempest-TestInstancesWithCinderVolumes-1564614376 None] Terminate volume connection completed successfully. Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-9e7a150d-4b97-4174-b0ef-06ef02385e53 req-d5379e4d-ef2e-4f61-bf64-417347b0d60e tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleting attachment e40e592c-192d-49fe-a1c1-49114880184e. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:25:40 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img Sep 01 00:25:40 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:40 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img" returned: 1 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:25:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:40 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3 Sep 01 00:25:40 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:41 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Image conversion details: src /opt/stack/data/cinder/conversion/e87e5d1a-b38a-48b1-bb44-73b774f39173.temp_image.4d1633e5-d161-464a-ab7f-8032127ebc61ad8rvp7b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:25:41 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62f9e42-4b9b-44c7-945b-bef40b3a11d7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:41 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3 Sep 01 00:25:41 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-0212a3e7-347e-438d-90d6-6bc1f031a89b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-0212a3e7-347e-438d-90d6-6bc1f031a89b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-quobyte-0212a3e7-347e-438d-90d6-6bc1f031a89b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-0212a3e7-347e-438d-90d6-6bc1f031a89b" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571e359-74b3-40ff-8309-8d1690d72bad]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:41 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rft8aqg3" returned: 0 in 0.366s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:41 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b Sep 01 00:25:41 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:41 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b" returned: 0 in 0.432s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:41 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b Sep 01 00:25:41 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:42 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0212a3e7-347e-438d-90d6-6bc1f031a89b" returned: 0 in 0.289s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-0212a3e7-347e-438d-90d6-6bc1f031a89b" released by "delete_volume" :: held 0.790s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:42 devstack cinder-volume[87803]: WARNING cinder.quota [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-434964803-1317643466 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-434964803-1317643466, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:42 devstack cinder-volume[87803]: WARNING cinder.quota [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-434964803-1317643466 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-434964803-1317643466, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Created reservations ['5adff2d2-d7dd-4e4a-9d24-e97e70fb2398', '5e64c1ea-d04c-4d5d-b76d-d66f97c8cd47', 'e7e73e20-7161-4dbf-89fa-e1fda480db7f', '7f432246-837b-48f2-8c91-c0407122424f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:42 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:42 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:42 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleted volume successfully. Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6aa8b16f-80a0-4e0f-85d1-b4f34156c4ba tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-0212a3e7-347e-438d-90d6-6bc1f031a89b-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.551s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Uploaded volume to glance image-id: 4d1633e5-d161-464a-ab7f-8032127ebc61. {{(pid=87803) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.297s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406789494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a94b1f-ac46-42cc-a164-0001a5e10351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb772f05abb04762b0757df09b3fc5fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:36Z,use_quota=True,user_id='5f5d1201d7364ef9a29adbd64b48051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Creating volume d2a94b1f-ac46-42cc-a164-0001a5e10351 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:25:42 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:25:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:42 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 1073741824 Sep 01 00:25:42 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0628189a-40b0-43fd-acc0-0db2ba8c25ad tempest-VolumesActionsTest-581923956 None] Copy volume to image completed successfully. Sep 01 00:25:43 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 1073741824" returned: 0 in 0.446s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:43 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 Sep 01 00:25:43 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:43 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.417s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1034355262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5f132-8572-4c75-aa6e-59cdfd8f8247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ff6e642a84dc081393db8f5d4b6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:37Z,use_quota=True,user_id='09aaa96f6add47a284fb165028a67127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Creating volume 30c5f132-8572-4c75-aa6e-59cdfd8f8247 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:25:43 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:43 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 1073741824 Sep 01 00:25:43 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bb019e-af09-4036-b593-0d91453ee8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a94b1f-ac46-42cc-a164-0001a5e10351', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee89a553-89c0-4229-95fd-4723a8d9d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:43 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Volume volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 (d2a94b1f-ac46-42cc-a164-0001a5e10351): created successfully Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee89a553-89c0-4229-95fd-4723a8d9d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Flow 'volume_create_manager' (91a967f0-46be-4b3e-a2fc-2cb4c05be81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ae6c146e-b69c-46cb-9d52-0d1aa724f78c tempest-VolumesActionsTest-64441313 None] Created volume successfully. Sep 01 00:25:44 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 1073741824" returned: 0 in 0.448s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:44 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 Sep 01 00:25:44 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:44 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77e70b3-a9bd-49d8-9aa0-afa5b6f08442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a170119e-f234-4572-8b7f-d30ce78ce48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Volume volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 (30c5f132-8572-4c75-aa6e-59cdfd8f8247): created successfully Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a170119e-f234-4572-8b7f-d30ce78ce48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Flow 'volume_create_manager' (6b7b961d-4ec4-4b81-aa36-8462bf97f17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2695fbb5-e9ef-44f0-9529-7a2fa1dc0f9a tempest-AttachVolumeNegativeTest-1698104254 None] Created volume successfully. Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Acquiring lock "cinder-quobyte-e87e5d1a-b38a-48b1-bb44-73b774f39173" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "cinder-quobyte-e87e5d1a-b38a-48b1-bb44-73b774f39173" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[22feca0d-c19b-4a76-8ee5-842a33f6c3ac]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:44 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:44 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-3ce3f46a-fc53-4c13-8276-a894fdfa0439 req-006f2da5-b7dc-4e14-826b-56ac9504f2fd tempest-TestInstancesWithCinderVolumes-1564614376 None] Terminate volume connection completed successfully. Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-3ce3f46a-fc53-4c13-8276-a894fdfa0439 req-006f2da5-b7dc-4e14-826b-56ac9504f2fd tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleting attachment ef648bed-0fe7-49d9-9557-62f7606da508. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:25:45 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.522s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:45 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173 Sep 01 00:25:45 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-d2a94b1f-ac46-42cc-a164-0001a5e10351-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "cinder-d2a94b1f-ac46-42cc-a164-0001a5e10351-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:45 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e87e5d1a-b38a-48b1-bb44-73b774f39173" returned: 0 in 0.288s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Acquiring lock "cinder-quobyte-d2a94b1f-ac46-42cc-a164-0001a5e10351" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "cinder-quobyte-e87e5d1a-b38a-48b1-bb44-73b774f39173" released by "delete_volume" :: held 0.866s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "cinder-quobyte-d2a94b1f-ac46-42cc-a164-0001a5e10351" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c365ec9-b234-43ae-a3e2-ca5f5ad561c0]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-cbd836a0-d199-4a9d-a7c3-2e3787b7ae0f req-cfd7d4ee-349c-45bb-a0a2-39fce6b75362 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-cbd836a0-d199-4a9d-a7c3-2e3787b7ae0f req-cfd7d4ee-349c-45bb-a0a2-39fce6b75362 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Created reservations ['9666d7f0-4608-42b6-883d-055689e2d0b6', '1992b131-865b-48b9-a5bb-32a6394cad63', '38764e3d-bed5-48a3-a85f-a65d2835f7b5', '89e5271a-3d27-4557-bda8-0a50c7884548'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-cbd836a0-d199-4a9d-a7c3-2e3787b7ae0f req-cfd7d4ee-349c-45bb-a0a2-39fce6b75362 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:45 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 Sep 01 00:25:45 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-cbd836a0-d199-4a9d-a7c3-2e3787b7ae0f req-cfd7d4ee-349c-45bb-a0a2-39fce6b75362 tempest-AttachVolumeNegativeTest-1698104254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcd4084e-92f7-4843-a9f2-449200e67d86', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:45 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:45 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-cbd836a0-d199-4a9d-a7c3-2e3787b7ae0f req-cfd7d4ee-349c-45bb-a0a2-39fce6b75362 tempest-AttachVolumeNegativeTest-1698104254 None] attachment_update completed successfully. Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-quobyte-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ff043-0890-4acc-a279-6f2b9acd0985]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:46 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351" returned: 0 in 0.609s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:46 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.447s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:46 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 Sep 01 00:25:46 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Deleted volume successfully. Sep 01 00:25:46 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351 Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b39bd4e9-c284-40d6-992a-966c7d75f15d tempest-VolumesActionsTest-581923956 None] Lock "cinder-e87e5d1a-b38a-48b1-bb44-73b774f39173-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:46 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:46 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d2a94b1f-ac46-42cc-a164-0001a5e10351" returned: 0 in 0.426s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "cinder-quobyte-d2a94b1f-ac46-42cc-a164-0001a5e10351" released by "delete_volume" :: held 1.087s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Created reservations ['3479123f-874f-40db-811b-4c05c9f3cbc7', 'df6de21b-c1b8-4471-a985-e070fbefd3eb', 'efa45809-cc20-46a7-a28c-5c9c94acdf49', '7378395e-2b2c-4dda-84e2-181feb5dd581'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:46 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" returned: 0 in 0.760s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:46 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5 Sep 01 00:25:46 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:46 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:46 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:47 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" returned: 0 in 0.428s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5" released by "delete_volume" :: held 1.274s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:47 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.394s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Deleted volume successfully. Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0ffe94f0-acbd-4adc-9e9e-f41895528ca1 tempest-VolumesActionsTest-64441313 None] Lock "cinder-d2a94b1f-ac46-42cc-a164-0001a5e10351-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:47 devstack cinder-volume[87803]: WARNING cinder.quota [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790432944-1944321336 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790432944-1944321336, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:47 devstack cinder-volume[87803]: WARNING cinder.quota [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790432944-1944321336 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790432944-1944321336, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Created reservations ['5c3e61fd-70ff-4ae4-9d19-3bf9c936b3f1', 'c697e6a8-9c86-417b-b0d3-88f8eb4c6efa', '5edcefb8-c74a-4f1e-8b3c-6ad10dbe2a68', 'b2f8ea9e-1387-49ec-91d5-724f3280221c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:47 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:47 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:47 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.349s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleted volume successfully. Sep 01 00:25:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc247c1e-93ab-4493-b333-466cbeb78bfb tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-968cb1b8-a3a0-4dac-8095-ecb0f6928ef5-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-2d890d75-28e8-4f87-a362-faedb882e629 req-0dac8249-6ad4-4220-8656-d60b2e7b838c tempest-AttachVolumeNegativeTest-1698104254 None] Terminate volume connection completed successfully. Sep 01 00:25:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-2d890d75-28e8-4f87-a362-faedb882e629 req-0dac8249-6ad4-4220-8656-d60b2e7b838c tempest-AttachVolumeNegativeTest-1698104254 None] Deleting attachment dcd4084e-92f7-4843-a9f2-449200e67d86. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:25:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-a1172a2f-3e6a-4e71-934a-ddb2d7d5294d req-56bf52e4-7e52-437e-8f58-8624b4321342 tempest-TestInstancesWithCinderVolumes-1564614376 None] Terminate volume connection completed successfully. Sep 01 00:25:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-a1172a2f-3e6a-4e71-934a-ddb2d7d5294d req-56bf52e4-7e52-437e-8f58-8624b4321342 tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleting attachment 96aa2db2-d82f-4dc5-b4e2-2ca42f9dc62f. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-30c5f132-8572-4c75-aa6e-59cdfd8f8247-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-30c5f132-8572-4c75-aa6e-59cdfd8f8247-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-quobyte-30c5f132-8572-4c75-aa6e-59cdfd8f8247" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-30c5f132-8572-4c75-aa6e-59cdfd8f8247" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[007bba0f-1a34-4872-8d24-fde57915725d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:56 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 Sep 01 00:25:56 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-060bf6ab-d725-41dd-870c-96308272ade5-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:56 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247" returned: 0 in 0.432s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-060bf6ab-d725-41dd-870c-96308272ade5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:56 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247 Sep 01 00:25:56 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "cinder-quobyte-060bf6ab-d725-41dd-870c-96308272ade5" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-060bf6ab-d725-41dd-870c-96308272ade5" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5dd1e-29f0-4d21-88ba-16a5efd07569]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 Sep 01 00:25:57 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:57 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-30c5f132-8572-4c75-aa6e-59cdfd8f8247" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-30c5f132-8572-4c75-aa6e-59cdfd8f8247" released by "delete_volume" :: held 0.836s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Flow 'volume_create_manager' (e472d34b-ed3b-4f25-a264-46caa32f9386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8637f87-9179-486a-9489-7cd0c3992c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8637f87-9179-486a-9489-7cd0c3992c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-69751271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab335b7ee8c848b78343224488b72278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:57Z,use_quota=True,user_id='f884c41658c149d1b8961c80cfa2b2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6888fd3-28dd-43c9-96e6-f787bc24c2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6888fd3-28dd-43c9-96e6-f787bc24c2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f7bcd-8987-4bbb-8e11-cec3eea7c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f7bcd-8987-4bbb-8e11-cec3eea7c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'volume_name': 'volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c43a4b5-f7c0-4252-a960-9aa54cbb956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c43a4b5-f7c0-4252-a960-9aa54cbb956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d125e3-60d6-4bf7-ab45-40afabd158b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Volume cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'volume_size': 1} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-69751271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab335b7ee8c848b78343224488b72278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:25:57Z,use_quota=True,user_id='f884c41658c149d1b8961c80cfa2b2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Creating volume cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:25:57 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e 1073741824 Sep 01 00:25:57 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Created reservations ['1fcc86e7-abc3-464d-91f5-f346f4b3b5ba', 'b4f48477-f2ad-40a2-a048-034787f4fca2', '93719548-720b-465d-b3d8-de06b9a1caba', '9f7b9235-1b65-4924-bbba-2655f494db60'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:57 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5" returned: 0 in 0.445s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5 Sep 01 00:25:57 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:57 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:57 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-060bf6ab-d725-41dd-870c-96308272ade5" returned: 0 in 0.308s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-quobyte-060bf6ab-d725-41dd-870c-96308272ade5" released by "delete_volume" :: held 0.823s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:57 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.283s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Deleted volume successfully. Sep 01 00:25:57 devstack cinder-volume[87803]: WARNING cinder.quota [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1746536320-1100181600 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1746536320-1100181600, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:57 devstack cinder-volume[87803]: WARNING cinder.quota [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1746536320-1100181600 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1746536320-1100181600, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7e178349-0838-4d41-a231-545f514fece2 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-30c5f132-8572-4c75-aa6e-59cdfd8f8247-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:57 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e 1073741824" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Created reservations ['957dd1bd-29b6-4c81-a819-4a74e70dd2c0', '3d04cb01-a4fc-4aa7-908e-f4067810283a', '53ff4684-6568-4b40-bc26-f671b89a5254', '1097aa7e-9d04-4d47-a55d-c09980651aab'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:25:57 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:57 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:57 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:58 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.343s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d125e3-60d6-4bf7-ab45-40afabd158b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c48ee2-c909-4083-9978-ed40eabaf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:25:58 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:58 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Volume volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e (cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e): created successfully Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c48ee2-c909-4083-9978-ed40eabaf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Flow 'volume_create_manager' (e472d34b-ed3b-4f25-a264-46caa32f9386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:25:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Deleted volume successfully. Sep 01 00:25:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-82104524-d50f-4267-bd4f-1f35823a90cc tempest-VolumesCloneTest-1645922510 None] Created volume successfully. Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5ea41789-c9ba-4612-a761-49152318c917 tempest-TestInstancesWithCinderVolumes-1564614376 None] Lock "cinder-060bf6ab-d725-41dd-870c-96308272ade5-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-8ed14f95-9c16-462e-aa7c-2e0da2777cdd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-8ed14f95-9c16-462e-aa7c-2e0da2777cdd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-quobyte-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b0899-a9d4-4c00-aae6-70063e41c6f7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:25:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:58 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd Sep 01 00:25:58 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:59 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:59 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd Sep 01 00:25:59 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:25:59 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-8ed14f95-9c16-462e-aa7c-2e0da2777cdd" released by "delete_volume" :: held 0.847s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Created reservations ['edb206f3-2839-405e-afd7-7453bdc3515f', '4fc3157e-556e-4e9a-97b8-c48d1e9b7dc6', '10c0f014-306f-409b-a442-dc592c03fdf3', '6d13ff69-c367-43d3-9ac1-0c9d26ed9dc4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:25:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:25:59 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:25:59 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Flow 'volume_create_manager' (a1aa7a9f-f11e-403c-b8de-f5791360a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c688a5c1-72ab-4003-bcf2-a31d92367833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c688a5c1-72ab-4003-bcf2-a31d92367833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-684014722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185d1199-1e4e-4c4c-a954-7b9d5e316804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab335b7ee8c848b78343224488b72278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:00Z,use_quota=True,user_id='f884c41658c149d1b8961c80cfa2b2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b38dd6-450c-4660-9e94-0ccae876ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b38dd6-450c-4660-9e94-0ccae876ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930f259-f21e-4877-b6bf-7194c824d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:00 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.542s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930f259-f21e-4877-b6bf-7194c824d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '185d1199-1e4e-4c4c-a954-7b9d5e316804', 'volume_name': 'volume-185d1199-1e4e-4c4c-a954-7b9d5e316804', 'volume_size': 2, 'source_volid': 'cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'source_volstatus': 'available'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985a18b-dce4-4fbd-9a67-530ec8018327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a985a18b-dce4-4fbd-9a67-530ec8018327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246c12e5-1152-449d-b448-a05ada2f64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Volume 185d1199-1e4e-4c4c-a954-7b9d5e316804: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-185d1199-1e4e-4c4c-a954-7b9d5e316804', 'volume_size': 2, 'source_volid': 'cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'source_volstatus': 'available'} Sep 01 00:26:00 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Deleted volume successfully. Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Cloning volume cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e to volume 185d1199-1e4e-4c4c-a954-7b9d5e316804 Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-04c7d8e6-091a-44d5-a25b-934bc0eead03 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-8ed14f95-9c16-462e-aa7c-2e0da2777cdd-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Creating offline snapshot 6b6766b5-40dc-459c-9bd3-9088efcf7370 of volume cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c03078-5c91-4d80-adb1-51216b574250]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-63d0d2e2-a35a-436a-b751-8e6fc031678f-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-63d0d2e2-a35a-436a-b751-8e6fc031678f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:00 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:26:00 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "cinder-quobyte-63d0d2e2-a35a-436a-b751-8e6fc031678f" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-63d0d2e2-a35a-436a-b751-8e6fc031678f" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe1a4c-b4ae-4a83-9afd-2047004c165d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:00 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f Sep 01 00:26:00 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:00 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.488s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:00 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 1G Sep 01 00:26:00 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:01 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f" returned: 0 in 0.475s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:01 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f Sep 01 00:26:01 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:01 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-63d0d2e2-a35a-436a-b751-8e6fc031678f" returned: 0 in 0.325s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-quobyte-63d0d2e2-a35a-436a-b751-8e6fc031678f" released by "delete_volume" :: held 0.859s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:01 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 1G" returned: 0 in 0.596s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:01 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:01 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Created reservations ['61015320-18ee-42fa-9af3-1791cb4fdee7', 'cd961dbd-4547-4f52-a083-bc7bacff2cae', 'f09bd65b-baa1-4f96-a9d4-7679290d9bf1', '9c28d185-0cad-471f-aa3e-50cd13de984c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:01 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:01 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:01 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.393s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:01 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 is being set with open permissions: ugo+rw Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:01 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:01 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:01 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:01 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:02 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Deleted volume successfully. Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-46698a32-46d5-455e-a72b-e6b20bcc1102 tempest-AttachVolumeNegativeTest-1698104254 None] Lock "cinder-63d0d2e2-a35a-436a-b751-8e6fc031678f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:02 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.278s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:02 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info Sep 01 00:26:02 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:02 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info" returned: 0 in 0.288s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:02 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info is being set with open permissions: ugo+rw Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:02 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info Sep 01 00:26:02 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:02 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.info" returned: 0 in 0.297s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] snapshot: 6b6766b5-40dc-459c-9bd3-9088efcf7370, volume: 185d1199-1e4e-4c4c-a954-7b9d5e316804, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b1005-c931-4f6f-a9dc-bf66aeccbd81]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:03 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:03 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:03 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.517s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d8a3d-a384-486e-8ef0-44de2104efd8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:03 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:26:03 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:03 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:26:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:03 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 Sep 01 00:26:03 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:07 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Flow 'volume_create_manager' (6f181ff0-4a86-4f7b-8486-fdab95216b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f355fab-0421-449a-8ffd-e88b210e8331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f355fab-0421-449a-8ffd-e88b210e8331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1189300192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd53126c-ecdb-4e1f-8980-9815fd979c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73fb3972931494db48521e0aebc80ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:08Z,use_quota=True,user_id='331f2d5cb2ef4883b8f5d33213fa2bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25360c40-52f9-4508-989d-d3a06cd8422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25360c40-52f9-4508-989d-d3a06cd8422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d08f83-a937-443d-8087-e87c4325219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d08f83-a937-443d-8087-e87c4325219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd53126c-ecdb-4e1f-8980-9815fd979c26', 'volume_name': 'volume-cd53126c-ecdb-4e1f-8980-9815fd979c26', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3214d12d-e5b1-4dcc-8c8e-163678242d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3214d12d-e5b1-4dcc-8c8e-163678242d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5fbf8c-6250-4b5f-9108-f4d5a379ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:08 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Volume cd53126c-ecdb-4e1f-8980-9815fd979c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd53126c-ecdb-4e1f-8980-9815fd979c26', 'volume_size': 1} Sep 01 00:26:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:09 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804" returned: 0 in 6.075s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:09 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:26:09 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Converted 1024.00 MB image at 168.54 MB/s Sep 01 00:26:09 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 is being set with open permissions: ugo+rw Sep 01 00:26:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:09 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 Sep 01 00:26:09 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:10 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" released by "_copy_volume_from_snapshot" :: held 7.409s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-quobyte-6b6766b5-40dc-459c-9bd3-9088efcf7370" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-6b6766b5-40dc-459c-9bd3-9088efcf7370" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Deleting offline snapshot 6b6766b5-40dc-459c-9bd3-9088efcf7370 of volume cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] snapshot_file for this snap is: volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a83c8b6-15ad-48e2-9912-8400999caf68]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:10 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:10 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:10 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.423s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaffae1-dea5-48cb-b458-8bcf5503b5ae]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:10 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:26:10 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:11 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.629s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:11 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:11 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:11 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:11 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370 Sep 01 00:26:11 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:11 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e.6b6766b5-40dc-459c-9bd3-9088efcf7370" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-6b6766b5-40dc-459c-9bd3-9088efcf7370" released by "_delete_snapshot" :: held 1.791s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.803s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.972s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1189300192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd53126c-ecdb-4e1f-8980-9815fd979c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73fb3972931494db48521e0aebc80ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:08Z,use_quota=True,user_id='331f2d5cb2ef4883b8f5d33213fa2bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Creating volume cd53126c-ecdb-4e1f-8980-9815fd979c26 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:12 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:12 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 1073741824 Sep 01 00:26:12 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246c12e5-1152-449d-b448-a05ada2f64f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185d1199-1e4e-4c4c-a954-7b9d5e316804', 'volume_size': 2, 'source_volid': 'cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e', 'source_volstatus': 'available'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4956bc22-5d58-4d23-84af-4eef3c6f2bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:12 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Volume volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 (185d1199-1e4e-4c4c-a954-7b9d5e316804): created successfully Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4956bc22-5d58-4d23-84af-4eef3c6f2bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Flow 'volume_create_manager' (a1aa7a9f-f11e-403c-b8de-f5791360a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:12 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ffa082d3-4916-461f-8c89-cf0ad74f523e tempest-VolumesCloneTest-1645922510 None] Created volume successfully. Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-185d1199-1e4e-4c4c-a954-7b9d5e316804-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-185d1199-1e4e-4c4c-a954-7b9d5e316804-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[69235d9b-600c-49e4-ab2f-f2f4596c10eb]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:12 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 1073741824" returned: 0 in 0.708s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:12 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 Sep 01 00:26:12 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:12 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 Sep 01 00:26:12 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:13 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26" returned: 0 in 0.336s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5fbf8c-6250-4b5f-9108-f4d5a379ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd53126c-ecdb-4e1f-8980-9815fd979c26', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8b2edf-ab64-4dd7-bf14-1d53ef912c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:13 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Volume volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 (cd53126c-ecdb-4e1f-8980-9815fd979c26): created successfully Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8b2edf-ab64-4dd7-bf14-1d53ef912c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Flow 'volume_create_manager' (6f181ff0-4a86-4f7b-8486-fdab95216b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ea09adce-72ae-4f35-a052-5ba767edc05a tempest-AbsoluteLimitsTests-915659223 None] Created volume successfully. Sep 01 00:26:13 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:13 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804 Sep 01 00:26:13 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:13 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:13 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:13 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-185d1199-1e4e-4c4c-a954-7b9d5e316804" returned: 0 in 0.326s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-185d1199-1e4e-4c4c-a954-7b9d5e316804" released by "delete_volume" :: held 0.906s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Created reservations ['89149dd0-c382-4052-8717-ab0a7483d266', '7886d39f-a9aa-4378-ad30-cd2d82ed60de', 'a32f0eda-8598-4997-9e1e-059973d45c11', '08534148-7169-4fd0-8e90-ae538947fe51'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:13 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:13 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:13 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:26:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "cinder-quobyte-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[088dd7e1-f0ad-4fa3-b4eb-20634645777f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:14 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.366s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Deleted volume successfully. Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-00661de1-00c2-4e5a-80c0-bba5771cb206 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-185d1199-1e4e-4c4c-a954-7b9d5e316804-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:14 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:26:14 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Acquiring lock "cinder-cd53126c-ecdb-4e1f-8980-9815fd979c26-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "cinder-cd53126c-ecdb-4e1f-8980-9815fd979c26-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Acquiring lock "cinder-quobyte-cd53126c-ecdb-4e1f-8980-9815fd979c26" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "cinder-quobyte-cd53126c-ecdb-4e1f-8980-9815fd979c26" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cc5d08-6232-469f-9e36-25b944957be0]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:14 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.527s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:14 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e Sep 01 00:26:14 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:14 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 Sep 01 00:26:14 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:14 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" returned: 0 in 0.297s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-quobyte-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e" released by "delete_volume" :: held 0.920s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Created reservations ['a39094c1-9d83-416a-9e5f-37c52024b874', 'c39a0648-0fe7-4170-8502-70add1afc630', '2ec33e46-0cdd-422d-8361-f02d3eb82ab2', 'bb871555-3da8-43f0-805a-f3e175402142'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:15 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:15 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26 Sep 01 00:26:15 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:15 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:15 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:15 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cd53126c-ecdb-4e1f-8980-9815fd979c26" returned: 0 in 0.379s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "cinder-quobyte-cd53126c-ecdb-4e1f-8980-9815fd979c26" released by "delete_volume" :: held 0.897s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:15 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.339s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:15 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Deleted volume successfully. Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Created reservations ['2f55b53f-ef29-402a-b316-1b2a5b611065', 'af4b9be0-4013-435a-a3af-c3e08109f414', 'f8229b3a-cca0-4a3c-8ddb-11e30eccf497', '25ed0510-95c1-49b8-afd8-e88ecc6babde'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2bd6e69c-9b24-4636-a2b1-d12e64e093e1 tempest-VolumesCloneTest-1645922510 None] Lock "cinder-cc7a60c9-2fd0-43c2-9a71-9d23d62b9a7e-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:15 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:15 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:15 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.266s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:15 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Deleted volume successfully. Sep 01 00:26:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2fe135d4-cee4-4435-a6af-ce9b96d872c7 tempest-AbsoluteLimitsTests-915659223 None] Lock "cinder-cd53126c-ecdb-4e1f-8980-9815fd979c26-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Flow 'volume_create_manager' (0fbc2ee4-fa48-46a6-8e6b-8e9d5147dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a106b150-5a3a-4e78-b454-558cb75f9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a106b150-5a3a-4e78-b454-558cb75f9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1471957671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6474a3-a144-4e13-912b-394f2de46ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c623580f28604ba09e18f263acfb024a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:19Z,use_quota=True,user_id='5d2e74b8a8dc4ee0a1f6fa22514c9ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ce0c5f-2818-4029-9516-7a987c2ea7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ce0c5f-2818-4029-9516-7a987c2ea7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e8c855-ee50-448b-98b2-d2bbedcade1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e8c855-ee50-448b-98b2-d2bbedcade1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6474a3-a144-4e13-912b-394f2de46ee7', 'volume_name': 'volume-fa6474a3-a144-4e13-912b-394f2de46ee7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d2d0a-ba6b-4833-9419-f6855f464f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d2d0a-ba6b-4833-9419-f6855f464f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254654e3-db27-48c8-abfc-f2035227624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Volume fa6474a3-a144-4e13-912b-394f2de46ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6474a3-a144-4e13-912b-394f2de46ee7', 'volume_size': 1} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1471957671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6474a3-a144-4e13-912b-394f2de46ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c623580f28604ba09e18f263acfb024a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:19Z,use_quota=True,user_id='5d2e74b8a8dc4ee0a1f6fa22514c9ada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Creating volume fa6474a3-a144-4e13-912b-394f2de46ee7 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:19 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:19 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 1073741824 Sep 01 00:26:19 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:20 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 1073741824" returned: 0 in 0.577s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:20 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 Sep 01 00:26:20 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:20 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254654e3-db27-48c8-abfc-f2035227624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6474a3-a144-4e13-912b-394f2de46ee7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52515336-0544-43c3-8ca2-1659f9f158fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:20 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Volume volume-fa6474a3-a144-4e13-912b-394f2de46ee7 (fa6474a3-a144-4e13-912b-394f2de46ee7): created successfully Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52515336-0544-43c3-8ca2-1659f9f158fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Flow 'volume_create_manager' (0fbc2ee4-fa48-46a6-8e6b-8e9d5147dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-612c1527-8d73-4f16-a07d-3d0a38e84c74 tempest-VolumesNegativeTest-1062465548 None] Created volume successfully. Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Flow 'volume_create_manager' (e60033ab-a73b-4b33-a23f-1062cfc8abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e69f0d-18f1-46a8-ba5e-6d703875e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e69f0d-18f1-46a8-ba5e-6d703875e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1186547681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bf5999-eca3-48ff-ab5a-fd9b751b6201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eb3e31891e4873b1280081f7b83ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:24Z,use_quota=True,user_id='7a31734a8c0d4ca480e9371df3475910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5e7c9d-d007-49ff-a46f-3fb6bdb81c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5e7c9d-d007-49ff-a46f-3fb6bdb81c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed5b3e-6bdb-46b7-a5ff-cd1a3856925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed5b3e-6bdb-46b7-a5ff-cd1a3856925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bf5999-eca3-48ff-ab5a-fd9b751b6201', 'volume_name': 'volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1cf93a-22d4-4670-8e0c-c9eee71b5082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1cf93a-22d4-4670-8e0c-c9eee71b5082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accd627f-0b3c-4285-819e-80ff3a43a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Volume 60bf5999-eca3-48ff-ab5a-fd9b751b6201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201', 'volume_size': 1} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1186547681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bf5999-eca3-48ff-ab5a-fd9b751b6201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73eb3e31891e4873b1280081f7b83ec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:24Z,use_quota=True,user_id='7a31734a8c0d4ca480e9371df3475910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Creating volume 60bf5999-eca3-48ff-ab5a-fd9b751b6201 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:24 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:24 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 1073741824 Sep 01 00:26:24 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:24 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 1073741824" returned: 0 in 0.723s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:25 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 Sep 01 00:26:25 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Flow 'volume_create_manager' (29140e48-1f8d-4727-ad1b-88b99673045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7446e2f9-d88f-4f49-9ceb-46f1bc90a3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7446e2f9-d88f-4f49-9ceb-46f1bc90a3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-45587631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f22c1d-7fc6-45a1-87f8-e412daaba8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0094a89dcd32448a92afba5b803a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:25Z,use_quota=True,user_id='e73530ed1b4c4ef388dc00dbae42df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e456bd-f1cf-4a18-91fc-51a0b46f9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e456bd-f1cf-4a18-91fc-51a0b46f9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2094d194-56ac-4495-a6d3-cbf4ee02231e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2094d194-56ac-4495-a6d3-cbf4ee02231e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f22c1d-7fc6-45a1-87f8-e412daaba8ee', 'volume_name': 'volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884addb1-5ce3-48fd-a8c9-a55713bf8d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884addb1-5ce3-48fd-a8c9-a55713bf8d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32be36ea-99a2-419e-8707-d47b5debdde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Volume 56f22c1d-7fc6-45a1-87f8-e412daaba8ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee', 'volume_size': 1} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:25 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201" returned: 0 in 0.341s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-45587631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f22c1d-7fc6-45a1-87f8-e412daaba8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0094a89dcd32448a92afba5b803a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:25Z,use_quota=True,user_id='e73530ed1b4c4ef388dc00dbae42df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Creating volume 56f22c1d-7fc6-45a1-87f8-e412daaba8ee {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:25 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:25 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee 1073741824 Sep 01 00:26:25 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accd627f-0b3c-4285-819e-80ff3a43a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0fda67-330d-4702-abae-38d0b8b584d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Volume volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 (60bf5999-eca3-48ff-ab5a-fd9b751b6201): created successfully Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0fda67-330d-4702-abae-38d0b8b584d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Flow 'volume_create_manager' (e60033ab-a73b-4b33-a23f-1062cfc8abce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6f849769-afce-473e-8801-7c862e363bad tempest-VolumesServicesTestJSON-259639667 None] Created volume successfully. Sep 01 00:26:25 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee 1073741824" returned: 0 in 0.591s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:26 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee Sep 01 00:26:26 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:26 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" returned: 0 in 0.384s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32be36ea-99a2-419e-8707-d47b5debdde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1b94bb-bc69-49f8-98d2-e87d3bf2adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Acquiring lock "cinder-60bf5999-eca3-48ff-ab5a-fd9b751b6201-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:26 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Volume volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee (56f22c1d-7fc6-45a1-87f8-e412daaba8ee): created successfully Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1b94bb-bc69-49f8-98d2-e87d3bf2adc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Flow 'volume_create_manager' (29140e48-1f8d-4727-ad1b-88b99673045a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "cinder-60bf5999-eca3-48ff-ab5a-fd9b751b6201-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:26 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4426b48d-51d3-4ae4-aaca-a87ed0a4f224 tempest-VolumesTransfersTest-1659594247 None] Created volume successfully. Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Acquiring lock "cinder-quobyte-60bf5999-eca3-48ff-ab5a-fd9b751b6201" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "cinder-quobyte-60bf5999-eca3-48ff-ab5a-fd9b751b6201" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7947c9-1409-4707-8eff-5a9aa139af62]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:26 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 Sep 01 00:26:26 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:27 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201" returned: 0 in 0.544s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:27 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201 Sep 01 00:26:27 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:27 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-60bf5999-eca3-48ff-ab5a-fd9b751b6201" returned: 0 in 0.369s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "cinder-quobyte-60bf5999-eca3-48ff-ab5a-fd9b751b6201" released by "delete_volume" :: held 0.975s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Created reservations ['8fb64d6f-bf07-49df-b2d1-b8bd51d59c77', 'f1168159-c06b-4750-96ce-a2384dae2b09', 'e6b36fca-0768-415b-8d48-3bb114bbf008', 'ab636fab-ec03-4453-9e70-94ae62135db5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:27 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:27 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-283ac397-dfea-4550-b516-c7ed2a374701 tempest-VolumesTransfersTest-1767293842 None] Transfer volume completed successfully. Sep 01 00:26:28 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Deleted volume successfully. Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79f22a53-f6b6-4eff-bbcd-732039185b5c tempest-VolumesServicesTestJSON-259639667 None] Lock "cinder-60bf5999-eca3-48ff-ab5a-fd9b751b6201-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "cinder-56f22c1d-7fc6-45a1-87f8-e412daaba8ee-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-56f22c1d-7fc6-45a1-87f8-e412daaba8ee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "cinder-quobyte-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-quobyte-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a04df-eb66-4dec-a0c1-2c52b8c22ae4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:29 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee Sep 01 00:26:29 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:29 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" returned: 0 in 0.484s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:29 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee Sep 01 00:26:29 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:29 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-quobyte-56f22c1d-7fc6-45a1-87f8-e412daaba8ee" released by "delete_volume" :: held 0.851s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:29 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Created reservations ['9381255f-3eca-40d1-959b-124e8e6e98b7', '2340c069-3380-4910-a162-b4ea4bdb2a46', 'b73dc12e-82cb-491e-8604-6f306576ca2a', '7311f9c6-8b85-4a47-9927-bf46e184abf5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:30 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:30 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:30 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.493s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Deleted volume successfully. Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b97c749a-babf-4118-9a44-6c07e83935a5 tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-56f22c1d-7fc6-45a1-87f8-e412daaba8ee-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=103,cinder:INSERT=38,cinder:UPDATE=144,cinder:DELETE=15 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=145,cinder:SELECT=116,cinder:DELETE=8,cinder:INSERT=29 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Flow 'volume_create_manager' (f43a8d31-cd5a-4587-a58e-5777bb4dc329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6baaca-65ce-4a90-97d7-95ac00cf6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6baaca-65ce-4a90-97d7-95ac00cf6b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-46434739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657758f3-596c-41f1-96c6-8a7e3347404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0094a89dcd32448a92afba5b803a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:31Z,use_quota=True,user_id='e73530ed1b4c4ef388dc00dbae42df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30cbe28-d2ee-48ed-8a0a-c83058123f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30cbe28-d2ee-48ed-8a0a-c83058123f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765e1ccb-2c39-44c1-8e51-46d49d0944a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765e1ccb-2c39-44c1-8e51-46d49d0944a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657758f3-596c-41f1-96c6-8a7e3347404b', 'volume_name': 'volume-657758f3-596c-41f1-96c6-8a7e3347404b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6bb1-1756-4f94-abda-8e04f170a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6bb1-1756-4f94-abda-8e04f170a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30fab9c-8a19-44f0-8c5d-501523f231c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Volume 657758f3-596c-41f1-96c6-8a7e3347404b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657758f3-596c-41f1-96c6-8a7e3347404b', 'volume_size': 1} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-46434739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657758f3-596c-41f1-96c6-8a7e3347404b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0094a89dcd32448a92afba5b803a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:31Z,use_quota=True,user_id='e73530ed1b4c4ef388dc00dbae42df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Creating volume 657758f3-596c-41f1-96c6-8a7e3347404b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:31 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:31 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b 1073741824 Sep 01 00:26:31 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b 1073741824" returned: 0 in 0.986s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:32 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:32 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b Sep 01 00:26:32 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:32 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30fab9c-8a19-44f0-8c5d-501523f231c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657758f3-596c-41f1-96c6-8a7e3347404b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfde9c2-0107-4f55-899d-2927817a0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Volume volume-657758f3-596c-41f1-96c6-8a7e3347404b (657758f3-596c-41f1-96c6-8a7e3347404b): created successfully Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfde9c2-0107-4f55-899d-2927817a0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Flow 'volume_create_manager' (f43a8d31-cd5a-4587-a58e-5777bb4dc329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f305c4da-4bf5-4471-ae9d-2b28792ee921 tempest-VolumesTransfersTest-1659594247 None] Created volume successfully. Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "cinder-657758f3-596c-41f1-96c6-8a7e3347404b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-657758f3-596c-41f1-96c6-8a7e3347404b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "cinder-quobyte-657758f3-596c-41f1-96c6-8a7e3347404b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-quobyte-657758f3-596c-41f1-96c6-8a7e3347404b" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a0642-4d04-4446-9ccc-30ef5041a97a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:33 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b Sep 01 00:26:33 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:34 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b" returned: 0 in 0.696s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:34 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b Sep 01 00:26:34 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:34 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-657758f3-596c-41f1-96c6-8a7e3347404b" returned: 0 in 0.319s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-quobyte-657758f3-596c-41f1-96c6-8a7e3347404b" released by "delete_volume" :: held 1.114s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Created reservations ['dc4538e4-d72a-4922-8fa2-eb1db3b2f127', '30e8be30-809b-4c22-a0b3-465e2aae7260', '16b1fa52-f264-4aee-95b2-c71fcfdca1cb', '4b3d7a0a-bb7e-43b2-967a-bc6d54462f16'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:34 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:34 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:35 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.361s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:35 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Deleted volume successfully. Sep 01 00:26:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39cf44cf-126f-41b6-a005-53b11f6fd73f tempest-VolumesTransfersTest-1705167040 None] Lock "cinder-657758f3-596c-41f1-96c6-8a7e3347404b-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:44 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:26:45 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Flow 'volume_create_manager' (53e1b3fe-5a01-46a6-a442-1b786b0c8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8535ab5-bc7a-4c88-82a8-6172f7e6e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8535ab5-bc7a-4c88-82a8-6172f7e6e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1654017747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9c34c168a44da9a959727ef4b36391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='8b16a77e5ec04aacac14d52e407de674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1caab98-a308-483f-9141-77608a7da65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1caab98-a308-483f-9141-77608a7da65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e513c32-3cb3-4a6d-aab5-0b39a2bdb94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e513c32-3cb3-4a6d-aab5-0b39a2bdb94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda', 'volume_name': 'volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd292ae-60f7-4484-ae99-d6c314dd18ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd292ae-60f7-4484-ae99-d6c314dd18ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db53eb5a-a5c5-4d34-b087-b0ce388cc6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda', 'volume_size': 1} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1654017747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9c34c168a44da9a959727ef4b36391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='8b16a77e5ec04aacac14d52e407de674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Creating volume fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:47 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:47 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda 1073741824 Sep 01 00:26:47 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Flow 'volume_create_manager' (45911310-0781-42a2-900c-50007a096179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:48 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ca6cbc-1511-4f47-a174-c026886b7aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda 1073741824" returned: 0 in 0.784s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ca6cbc-1511-4f47-a174-c026886b7aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1513052565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d20877-1e3d-4781-9577-0322e2fa7bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865001f0c24f4c48af5690ce0c866ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='43b041d7fea0495ab58f18e70ee61f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65b6739-b850-4e0f-a785-2cbbd4708f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65b6739-b850-4e0f-a785-2cbbd4708f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207ee4f-22ac-4a95-b65c-ade15e727c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9207ee4f-22ac-4a95-b65c-ade15e727c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d20877-1e3d-4781-9577-0322e2fa7bbd', 'volume_name': 'volume-51d20877-1e3d-4781-9577-0322e2fa7bbd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a44385b-97f4-4864-9043-21698b99e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a44385b-97f4-4864-9043-21698b99e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1042d42-21ef-48d3-8d0a-6d1e7cbff3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Volume 51d20877-1e3d-4781-9577-0322e2fa7bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d20877-1e3d-4781-9577-0322e2fa7bbd', 'volume_size': 1} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Flow 'volume_create_manager' (122aa7f1-8b6f-4aa6-9e49-f74563937012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a563f2e-bf57-4e41-8e90-dda6a510ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a563f2e-bf57-4e41-8e90-dda6a510ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1950178200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04207770-7f47-44c6-9ea5-c6b78cd7b407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9c34c168a44da9a959727ef4b36391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='8b16a77e5ec04aacac14d52e407de674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac2ce7-fe8e-4573-831a-3228601fefc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac2ce7-fe8e-4573-831a-3228601fefc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96830c1e-1333-46a2-bd13-4b01e10e4d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96830c1e-1333-46a2-bd13-4b01e10e4d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04207770-7f47-44c6-9ea5-c6b78cd7b407', 'volume_name': 'volume-04207770-7f47-44c6-9ea5-c6b78cd7b407', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d86dd81-9e60-4c8b-83ed-137df5b60d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d86dd81-9e60-4c8b-83ed-137df5b60d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee580c3-ffe0-476b-bedf-3e8faecff7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:48 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume 04207770-7f47-44c6-9ea5-c6b78cd7b407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04207770-7f47-44c6-9ea5-c6b78cd7b407', 'volume_size': 1} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:48 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda Sep 01 00:26:48 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:49 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1513052565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d20877-1e3d-4781-9577-0322e2fa7bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865001f0c24f4c48af5690ce0c866ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='43b041d7fea0495ab58f18e70ee61f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Creating volume 51d20877-1e3d-4781-9577-0322e2fa7bbd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:49 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db53eb5a-a5c5-4d34-b087-b0ce388cc6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:49 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd 1073741824 Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f9220f-1fe1-47c9-b45f-9eeff2ac7fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:49 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:49 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda (fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda): created successfully Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f9220f-1fe1-47c9-b45f-9eeff2ac7fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Flow 'volume_create_manager' (53e1b3fe-5a01-46a6-a442-1b786b0c8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3a8b6325-de90-4ac9-b2fe-df866939f03a tempest-TestServerVolumeAttachmentScenario-351257321 None] Created volume successfully. Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Acquiring lock "cinder-fa6474a3-a144-4e13-912b-394f2de46ee7-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "cinder-fa6474a3-a144-4e13-912b-394f2de46ee7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Acquiring lock "cinder-quobyte-fa6474a3-a144-4e13-912b-394f2de46ee7" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "cinder-quobyte-fa6474a3-a144-4e13-912b-394f2de46ee7" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a5a7f2-b5cf-442c-9346-f6d5069e8002]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:49 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 Sep 01 00:26:49 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:49 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd 1073741824" returned: 0 in 0.648s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:49 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd Sep 01 00:26:49 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:50 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7" returned: 0 in 0.470s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:50 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:50 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7 Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:50 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1950178200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04207770-7f47-44c6-9ea5-c6b78cd7b407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9c34c168a44da9a959727ef4b36391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:48Z,use_quota=True,user_id='8b16a77e5ec04aacac14d52e407de674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Creating volume 04207770-7f47-44c6-9ea5-c6b78cd7b407 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:50 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:50 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 1073741824 Sep 01 00:26:50 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1042d42-21ef-48d3-8d0a-6d1e7cbff3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d20877-1e3d-4781-9577-0322e2fa7bbd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa1b9d5-2c01-4016-9a8e-b04afd0e2072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:50 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Volume volume-51d20877-1e3d-4781-9577-0322e2fa7bbd (51d20877-1e3d-4781-9577-0322e2fa7bbd): created successfully Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa1b9d5-2c01-4016-9a8e-b04afd0e2072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Flow 'volume_create_manager' (45911310-0781-42a2-900c-50007a096179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2e4296cf-aabc-44a6-b01f-0e512356160b tempest-VolumesTransfersV355Test-1091111135 None] Created volume successfully. Sep 01 00:26:50 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa6474a3-a144-4e13-912b-394f2de46ee7" returned: 0 in 0.416s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "cinder-quobyte-fa6474a3-a144-4e13-912b-394f2de46ee7" released by "delete_volume" :: held 0.935s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Created reservations ['0e5bd2de-e005-4ad2-a707-206b7d32d3bc', 'f386a8e4-9045-4bc6-b260-a64d8a387bd0', 'eb2982e0-4322-4595-85fc-08c481d6c3d1', 'f1376698-6a09-4776-ba57-efb4270f9942'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:50 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:50 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:50 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 1073741824" returned: 0 in 0.622s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:50 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 Sep 01 00:26:50 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:51 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Deleted volume successfully. Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7edcfc96-c9e7-4c67-8767-73d6d3eed3d7 tempest-VolumesNegativeTest-1062465548 None] Lock "cinder-fa6474a3-a144-4e13-912b-394f2de46ee7-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:51 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee580c3-ffe0-476b-bedf-3e8faecff7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04207770-7f47-44c6-9ea5-c6b78cd7b407', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55a10fb-6df9-4081-9596-6a7c59e7e724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:51 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Volume volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 (04207770-7f47-44c6-9ea5-c6b78cd7b407): created successfully Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55a10fb-6df9-4081-9596-6a7c59e7e724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Flow 'volume_create_manager' (122aa7f1-8b6f-4aa6-9e49-f74563937012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2408743d-0ecd-48a5-9592-6e4a756ccb4a tempest-TestServerVolumeAttachmentScenario-351257321 None] Created volume successfully. Sep 01 00:26:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7dec4b26-36a8-4a73-b688-8bf72d3a01c5 tempest-VolumesTransfersV355Test-1485871492 None] Transfer volume completed successfully. Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "cinder-51d20877-1e3d-4781-9577-0322e2fa7bbd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-51d20877-1e3d-4781-9577-0322e2fa7bbd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "cinder-quobyte-51d20877-1e3d-4781-9577-0322e2fa7bbd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-quobyte-51d20877-1e3d-4781-9577-0322e2fa7bbd" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c731afb3-b06d-44e7-a0d0-1c0d25272882]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:53 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd Sep 01 00:26:53 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:53 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd" returned: 0 in 0.519s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:53 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd Sep 01 00:26:53 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:54 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-51d20877-1e3d-4781-9577-0322e2fa7bbd" returned: 0 in 0.329s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-quobyte-51d20877-1e3d-4781-9577-0322e2fa7bbd" released by "delete_volume" :: held 0.918s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Created reservations ['a5dee5cc-5e26-4ec9-bc94-0d8c2d4b4bc9', 'ce5c6430-b6a2-4029-b470-9e3047708391', '3e158706-74ea-4132-9a18-c5aa31b75a50', '73cb828d-79bf-44d3-8cf2-ba139893189c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:54 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:26:54 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:54 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:26:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Deleted volume successfully. Sep 01 00:26:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-448d3267-013e-4218-965a-38a37189fd8e tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-51d20877-1e3d-4781-9577-0322e2fa7bbd-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Flow 'volume_create_manager' (20097adb-202e-42e8-b2b9-6664f34aae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bb48b5-5b17-4bc0-985c-d814681e5885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bb48b5-5b17-4bc0-985c-d814681e5885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1368038772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdde480b-0814-4c90-b72b-f79607f8ca4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865001f0c24f4c48af5690ce0c866ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:56Z,use_quota=True,user_id='43b041d7fea0495ab58f18e70ee61f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03027636-56c6-4da0-9d1b-a1fda16b6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03027636-56c6-4da0-9d1b-a1fda16b6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06d46a6-0b10-4bab-abdb-d123156fcc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06d46a6-0b10-4bab-abdb-d123156fcc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdde480b-0814-4c90-b72b-f79607f8ca4a', 'volume_name': 'volume-cdde480b-0814-4c90-b72b-f79607f8ca4a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e97f6ea-63c6-46a4-b65b-2a04cf08fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e97f6ea-63c6-46a4-b65b-2a04cf08fa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90224dfa-6017-4d09-8251-26ae435c9c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Volume cdde480b-0814-4c90-b72b-f79607f8ca4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdde480b-0814-4c90-b72b-f79607f8ca4a', 'volume_size': 1} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1368038772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdde480b-0814-4c90-b72b-f79607f8ca4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865001f0c24f4c48af5690ce0c866ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:26:56Z,use_quota=True,user_id='43b041d7fea0495ab58f18e70ee61f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Creating volume cdde480b-0814-4c90-b72b-f79607f8ca4a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:26:56 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:56 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a 1073741824 Sep 01 00:26:56 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:56 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a 1073741824" returned: 0 in 0.579s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:56 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a Sep 01 00:26:56 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:57 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90224dfa-6017-4d09-8251-26ae435c9c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdde480b-0814-4c90-b72b-f79607f8ca4a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9428ce6-69b3-4682-9524-c9526294bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:26:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Volume volume-cdde480b-0814-4c90-b72b-f79607f8ca4a (cdde480b-0814-4c90-b72b-f79607f8ca4a): created successfully Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9428ce6-69b3-4682-9524-c9526294bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:26:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Flow 'volume_create_manager' (20097adb-202e-42e8-b2b9-6664f34aae49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:26:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4fb47a04-4334-42e2-96eb-d5668f706db0 tempest-VolumesTransfersV355Test-1091111135 None] Created volume successfully. Sep 01 00:26:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "cinder-cdde480b-0814-4c90-b72b-f79607f8ca4a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-cdde480b-0814-4c90-b72b-f79607f8ca4a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "cinder-quobyte-cdde480b-0814-4c90-b72b-f79607f8ca4a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:26:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-quobyte-cdde480b-0814-4c90-b72b-f79607f8ca4a" acquired by "delete_volume" :: waited 0.051s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:26:59 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2df99e-3fe6-477b-b34f-3568a4df5cd9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:26:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:59 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a Sep 01 00:26:59 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:26:59 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 01 00:26:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a" returned: 0 in 0.804s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:26:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:26:59 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a Sep 01 00:26:59 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:00 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-cdde480b-0814-4c90-b72b-f79607f8ca4a" returned: 0 in 0.557s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-quobyte-cdde480b-0814-4c90-b72b-f79607f8ca4a" released by "delete_volume" :: held 1.470s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Flow 'volume_create_manager' (89ef735b-950a-48c7-9e0d-4aa3cab30b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee798bc8-f253-4c88-905f-0d72d6282850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee798bc8-f253-4c88-905f-0d72d6282850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1639864658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c30ff4-5e82-46b3-8678-04566da9eafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6d32ecb7ce4b0badcde895b7859a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:00Z,use_quota=True,user_id='f9c136c4c90c49d2b299b1a48e932861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bc9281-4308-48a5-87c9-1541ae57c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bc9281-4308-48a5-87c9-1541ae57c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965c266e-c2ce-4be6-bf3a-b986395dfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965c266e-c2ce-4be6-bf3a-b986395dfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c30ff4-5e82-46b3-8678-04566da9eafd', 'volume_name': 'volume-21c30ff4-5e82-46b3-8678-04566da9eafd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7489f3-1e86-4456-8c51-d4ce0fc6d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7489f3-1e86-4456-8c51-d4ce0fc6d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809a6bec-3ec3-48d5-ba5b-80b426099ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Volume 21c30ff4-5e82-46b3-8678-04566da9eafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c30ff4-5e82-46b3-8678-04566da9eafd', 'volume_size': 1} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1639864658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c30ff4-5e82-46b3-8678-04566da9eafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b6d32ecb7ce4b0badcde895b7859a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:00Z,use_quota=True,user_id='f9c136c4c90c49d2b299b1a48e932861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Creating volume 21c30ff4-5e82-46b3-8678-04566da9eafd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:00 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd 1073741824 Sep 01 00:27:00 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Created reservations ['3c45a574-0a2b-4953-8abc-3cf622091999', '8ca21473-4022-46a8-8173-f99c919bfc40', 'fd5af762-3758-4973-aa19-d34eecaeba68', 'cda9e216-171c-448e-ab38-9a3e7c9d4d12'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:00 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:00 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:01 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.341s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Deleted volume successfully. Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-22449110-8175-4a92-9047-a98c6ae583f0 tempest-VolumesTransfersV355Test-352644815 None] Lock "cinder-cdde480b-0814-4c90-b72b-f79607f8ca4a-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:01 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd 1073741824" returned: 0 in 0.835s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:01 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd Sep 01 00:27:01 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:01 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809a6bec-3ec3-48d5-ba5b-80b426099ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c30ff4-5e82-46b3-8678-04566da9eafd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b017f2-1bce-4a3d-af2c-520246edccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:01 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Volume volume-21c30ff4-5e82-46b3-8678-04566da9eafd (21c30ff4-5e82-46b3-8678-04566da9eafd): created successfully Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b017f2-1bce-4a3d-af2c-520246edccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Flow 'volume_create_manager' (89ef735b-950a-48c7-9e0d-4aa3cab30b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-61460a0f-669e-4bb8-9f10-139bd044a047 tempest-VolumesMetadataTest-1547487812 None] Created volume successfully. Sep 01 00:27:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Acquiring lock "cinder-21c30ff4-5e82-46b3-8678-04566da9eafd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "cinder-21c30ff4-5e82-46b3-8678-04566da9eafd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Acquiring lock "cinder-quobyte-21c30ff4-5e82-46b3-8678-04566da9eafd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "cinder-quobyte-21c30ff4-5e82-46b3-8678-04566da9eafd" acquired by "delete_volume" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d566d81-d94e-4b7a-888e-694af4259200]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:04 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd Sep 01 00:27:04 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:04 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:04 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd Sep 01 00:27:04 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:04 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-21c30ff4-5e82-46b3-8678-04566da9eafd" returned: 0 in 0.320s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "cinder-quobyte-21c30ff4-5e82-46b3-8678-04566da9eafd" released by "delete_volume" :: held 0.960s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Created reservations ['836a0f81-7f0c-4487-8d0c-5d7dfbe1bc60', '001f5892-4728-474e-8cc8-6360e256dc50', '00f0432c-0948-4fff-9f69-15f1eb1cb5e5', '9d8b2c0f-f59c-427d-915e-0f7495b29e28'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:05 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:05 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:05 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.383s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Deleted volume successfully. Sep 01 00:27:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-61309a3c-2103-4e27-a479-dbfbccfeb9ec tempest-VolumesMetadataTest-1547487812 None] Lock "cinder-21c30ff4-5e82-46b3-8678-04566da9eafd-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:13 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:13 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:13 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.336s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:27:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Flow 'volume_create_manager' (13b4539a-f84e-42c0-a9b1-c23cd5f50de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23347632-10a1-4df0-8ace-c5554ceb0a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23347632-10a1-4df0-8ace-c5554ceb0a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974888002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0748f45-14a6-43d0-b628-644327d99c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d9b4d1fb724d2f8c247b76fa9b1939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:15Z,use_quota=True,user_id='c3bd2c9d364147e484b63ad4f43162c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee018ef3-7e35-4c5e-a8be-865e599b0bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee018ef3-7e35-4c5e-a8be-865e599b0bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b29f9-4410-49b7-ad02-ed5929b14abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55b29f9-4410-49b7-ad02-ed5929b14abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0748f45-14a6-43d0-b628-644327d99c2b', 'volume_name': 'volume-e0748f45-14a6-43d0-b628-644327d99c2b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e7cc6-53a2-4bdf-bea6-bc66c9ecd19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e7cc6-53a2-4bdf-bea6-bc66c9ecd19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ad931a-f008-44de-9660-3964b80727de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:14 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Volume e0748f45-14a6-43d0-b628-644327d99c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0748f45-14a6-43d0-b628-644327d99c2b', 'volume_size': 1} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974888002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0748f45-14a6-43d0-b628-644327d99c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d9b4d1fb724d2f8c247b76fa9b1939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:15Z,use_quota=True,user_id='c3bd2c9d364147e484b63ad4f43162c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Creating volume e0748f45-14a6-43d0-b628-644327d99c2b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:14 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:14 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b 1073741824 Sep 01 00:27:14 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:15 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b 1073741824" returned: 0 in 0.519s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:15 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b Sep 01 00:27:15 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:15 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b" returned: 0 in 0.303s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ad931a-f008-44de-9660-3964b80727de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0748f45-14a6-43d0-b628-644327d99c2b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514900b2-5ca7-40ac-af37-ca4a2a69d097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:15 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Volume volume-e0748f45-14a6-43d0-b628-644327d99c2b (e0748f45-14a6-43d0-b628-644327d99c2b): created successfully Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514900b2-5ca7-40ac-af37-ca4a2a69d097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Flow 'volume_create_manager' (13b4539a-f84e-42c0-a9b1-c23cd5f50de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:15 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-86888bbe-0ed6-4a5d-9e5e-bde3048dc8ae tempest-VolumesTransfersV357Test-997617060 None] Created volume successfully. Sep 01 00:27:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7c9d3f0d-59f4-4a30-93a9-b5ad5f6a8a93 tempest-VolumesTransfersV357Test-126744009 None] Transfer volume completed successfully. Sep 01 00:27:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "cinder-e0748f45-14a6-43d0-b628-644327d99c2b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-e0748f45-14a6-43d0-b628-644327d99c2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "cinder-quobyte-e0748f45-14a6-43d0-b628-644327d99c2b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-quobyte-e0748f45-14a6-43d0-b628-644327d99c2b" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac071c-151e-4bef-859b-8e921f225b1a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:18 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b Sep 01 00:27:18 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:18 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b" returned: 0 in 0.513s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:18 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b Sep 01 00:27:18 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:18 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0748f45-14a6-43d0-b628-644327d99c2b" returned: 0 in 0.304s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-quobyte-e0748f45-14a6-43d0-b628-644327d99c2b" released by "delete_volume" :: held 0.875s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Created reservations ['bd7b4b95-8850-451e-a491-215d52759387', '352c7179-bc32-4cc2-91ec-23b8e067492d', '9d5a84fd-aed6-4afe-9f20-dba5a85f2b43', '38938d09-ba4d-4a6f-9366-33043d90b7c2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:19 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:19 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:19 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.325s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Deleted volume successfully. Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-99d23e3b-1066-455a-8842-4b2be24b36c2 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-e0748f45-14a6-43d0-b628-644327d99c2b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:19 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Flow 'volume_create_manager' (e66cfda1-7635-4ed8-9816-b80c16e17fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6389020-4697-4418-b35a-e1b789ab5d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6389020-4697-4418-b35a-e1b789ab5d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089893077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a16726a-3c27-4fdf-8666-8c80e542c644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d9b4d1fb724d2f8c247b76fa9b1939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:20Z,use_quota=True,user_id='c3bd2c9d364147e484b63ad4f43162c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b049cce-4e70-4859-a59f-189bee9429f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b049cce-4e70-4859-a59f-189bee9429f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e51d820-bb73-483a-9c28-498324dc8d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e51d820-bb73-483a-9c28-498324dc8d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a16726a-3c27-4fdf-8666-8c80e542c644', 'volume_name': 'volume-9a16726a-3c27-4fdf-8666-8c80e542c644', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ca4fa-2afd-47ed-93a2-915fb5acf1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ca4fa-2afd-47ed-93a2-915fb5acf1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9beb56-5666-4308-9716-382103a5f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:20 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Volume 9a16726a-3c27-4fdf-8666-8c80e542c644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a16726a-3c27-4fdf-8666-8c80e542c644', 'volume_size': 1} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089893077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a16726a-3c27-4fdf-8666-8c80e542c644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d9b4d1fb724d2f8c247b76fa9b1939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:20Z,use_quota=True,user_id='c3bd2c9d364147e484b63ad4f43162c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Creating volume 9a16726a-3c27-4fdf-8666-8c80e542c644 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:20 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:20 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 1073741824 Sep 01 00:27:20 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:20 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 1073741824" returned: 0 in 0.546s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:20 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 Sep 01 00:27:20 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:20 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644" returned: 0 in 0.280s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9beb56-5666-4308-9716-382103a5f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a16726a-3c27-4fdf-8666-8c80e542c644', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db49bb7-ad9a-4ff9-8dd8-8047c9afd6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Volume volume-9a16726a-3c27-4fdf-8666-8c80e542c644 (9a16726a-3c27-4fdf-8666-8c80e542c644): created successfully Sep 01 00:27:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db49bb7-ad9a-4ff9-8dd8-8047c9afd6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Flow 'volume_create_manager' (e66cfda1-7635-4ed8-9816-b80c16e17fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9ce5e640-62ce-4ff2-98c3-36c3281ca66b tempest-VolumesTransfersV357Test-997617060 None] Created volume successfully. Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "cinder-9a16726a-3c27-4fdf-8666-8c80e542c644-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-9a16726a-3c27-4fdf-8666-8c80e542c644-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "cinder-quobyte-9a16726a-3c27-4fdf-8666-8c80e542c644" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-quobyte-9a16726a-3c27-4fdf-8666-8c80e542c644" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711c039-3978-4d48-bfdd-c3cf4288b0a4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:22 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 Sep 01 00:27:22 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:23 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644" returned: 0 in 0.524s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:23 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644 Sep 01 00:27:23 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:23 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9a16726a-3c27-4fdf-8666-8c80e542c644" returned: 0 in 0.354s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-quobyte-9a16726a-3c27-4fdf-8666-8c80e542c644" released by "delete_volume" :: held 0.950s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Created reservations ['caed9f6c-86ce-4496-a7c2-bb0b7a12e2c2', '0e5f21b2-66b9-41e4-99e2-00e784f3eeb4', 'f3f8ebf1-985d-40e4-a150-f41c3ae39448', '87762339-c896-4e99-86f4-b13a353f702b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:23 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:23 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:24 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.373s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:24 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Deleted volume successfully. Sep 01 00:27:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b1e8594d-ea98-4f23-bfaa-befbe29470e5 tempest-VolumesTransfersV357Test-2075080464 None] Lock "cinder-9a16726a-3c27-4fdf-8666-8c80e542c644-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-e00290e7-d4a5-41fa-b51a-f730cee11f52 req-76dd504b-b33b-4e84-aa59-5c0937a4846b tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-e00290e7-d4a5-41fa-b51a-f730cee11f52 req-76dd504b-b33b-4e84-aa59-5c0937a4846b tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-e00290e7-d4a5-41fa-b51a-f730cee11f52 req-76dd504b-b33b-4e84-aa59-5c0937a4846b tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-e00290e7-d4a5-41fa-b51a-f730cee11f52 req-76dd504b-b33b-4e84-aa59-5c0937a4846b tempest-TestServerVolumeAttachmentScenario-351257321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38550dd0-c181-443b-86ba-e2d195ccb8ed', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:27:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-e00290e7-d4a5-41fa-b51a-f730cee11f52 req-76dd504b-b33b-4e84-aa59-5c0937a4846b tempest-TestServerVolumeAttachmentScenario-351257321 None] attachment_update completed successfully. Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Flow 'volume_create_manager' (58e520d7-578b-40e4-8ee0-15d0d6718c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc941b7d-3c4c-4250-aeca-0226f4ad6ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc941b7d-3c4c-4250-aeca-0226f4ad6ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-625495729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8016160a-238d-4616-bbbe-ccd45e68c9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2bdbf74d124666944d08788bfcc79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:33Z,use_quota=True,user_id='c77bf60491b845339f9b2a89fbcff648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1567cb1-7c53-4128-9400-36c299d438fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1567cb1-7c53-4128-9400-36c299d438fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ec53e9-002f-4b7d-a32a-aea8bdfbbda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:33 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ec53e9-002f-4b7d-a32a-aea8bdfbbda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8016160a-238d-4616-bbbe-ccd45e68c9e9', 'volume_name': 'volume-8016160a-238d-4616-bbbe-ccd45e68c9e9', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a169e419-391e-462a-9bce-95ab577774bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a169e419-391e-462a-9bce-95ab577774bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce51394-2bde-48e3-9a95-e14b393ffa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Volume 8016160a-238d-4616-bbbe-ccd45e68c9e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8016160a-238d-4616-bbbe-ccd45e68c9e9', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Trying to clone 8016160a-238d-4616-bbbe-ccd45e68c9e9 from image df40e229-b455-4243-a6fd-53ca30610169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Flow 'volume_create_manager' (2c8f9ea8-6a9e-460f-bfd6-2f4b4684d91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d21335-386b-4f1d-9acc-041ca27e7aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d21335-386b-4f1d-9acc-041ca27e7aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2043751146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ed3c4c-399e-468d-9cd3-0c147a183a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1966191268924d4b8113d26a1f096021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:34Z,use_quota=True,user_id='7563edfb234f42beafd570c84ece2aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98fc89-af88-4c29-ab63-35bf7d732507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98fc89-af88-4c29-ab63-35bf7d732507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded9eed1-8aab-4154-930a-15392ae5093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded9eed1-8aab-4154-930a-15392ae5093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ed3c4c-399e-468d-9cd3-0c147a183a63', 'volume_name': 'volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63', 'volume_size': 2}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42300a8-61a8-4a65-971f-98c168a31676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42300a8-61a8-4a65-971f-98c168a31676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa773a6-b43b-4afb-b7bf-d1681188ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Volume f2ed3c4c-399e-468d-9cd3-0c147a183a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63', 'volume_size': 2} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2043751146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ed3c4c-399e-468d-9cd3-0c147a183a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1966191268924d4b8113d26a1f096021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:34Z,use_quota=True,user_id='7563edfb234f42beafd570c84ece2aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Creating volume f2ed3c4c-399e-468d-9cd3-0c147a183a63 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:34 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 2147483648 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:34 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 2147483648 Sep 01 00:27:34 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:27:34 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Image download 20.69 MB at 20.69 MB/s Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3e91ba-9da3-4f11-a409-bfa4d686786b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-081f6666-00c2-434a-8fec-f127813913d5 req-4292e30a-3b7a-44a8-8299-688900a26aae tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:34 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD Sep 01 00:27:34 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:35 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 2147483648" returned: 0 in 0.600s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:35 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 is fetched for user c77bf60491b845339f9b2a89fbcff648. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:27:35 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 Sep 01 00:27:35 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4303c7-1bae-4754-b903-f76d9c784468]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:35 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD Sep 01 00:27:35 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:35 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63" returned: 0 in 0.280s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-081f6666-00c2-434a-8fec-f127813913d5 req-4292e30a-3b7a-44a8-8299-688900a26aae tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.603s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa773a6-b43b-4afb-b7bf-d1681188ff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63', 'volume_size': 2}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8e3d61-673e-4514-b674-7067337d5b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-081f6666-00c2-434a-8fec-f127813913d5 req-4292e30a-3b7a-44a8-8299-688900a26aae tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:35 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Volume volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 (f2ed3c4c-399e-468d-9cd3-0c147a183a63): created successfully Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8e3d61-673e-4514-b674-7067337d5b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Flow 'volume_create_manager' (2c8f9ea8-6a9e-460f-bfd6-2f4b4684d91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3035f781-82e7-43da-aa7f-0f5fae6f0807 tempest-VolumesCloneNegativeTest-1557105922 None] Created volume successfully. Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-081f6666-00c2-434a-8fec-f127813913d5 req-4292e30a-3b7a-44a8-8299-688900a26aae tempest-TestServerVolumeAttachmentScenario-351257321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-04207770-7f47-44c6-9ea5-c6b78cd7b407', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1434e201-992d-4939-9d3e-1ee3b6c98861', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:27:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-081f6666-00c2-434a-8fec-f127813913d5 req-4292e30a-3b7a-44a8-8299-688900a26aae tempest-TestServerVolumeAttachmentScenario-351257321 None] attachment_update completed successfully. Sep 01 00:27:35 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-625495729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8016160a-238d-4616-bbbe-ccd45e68c9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f2bdbf74d124666944d08788bfcc79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:33Z,use_quota=True,user_id='c77bf60491b845339f9b2a89fbcff648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Creating volume 8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:35 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1073741824 Sep 01 00:27:35 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:36 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1073741824" returned: 0 in 0.543s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:36 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 Sep 01 00:27:36 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:36 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Acquiring lock "cinder-f2ed3c4c-399e-468d-9cd3-0c147a183a63-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9" returned: 0 in 0.312s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "cinder-f2ed3c4c-399e-468d-9cd3-0c147a183a63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Attempting download of df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume 8016160a-238d-4616-bbbe-ccd45e68c9e9. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Acquiring lock "cinder-quobyte-f2ed3c4c-399e-468d-9cd3-0c147a183a63" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "cinder-quobyte-f2ed3c4c-399e-468d-9cd3-0c147a183a63" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469021c-09c6-450c-ab7b-2d4396f0cc75]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274ea9d-d18d-48dc-a4fe-62ed56843462]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:36 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 Sep 01 00:27:36 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc Sep 01 00:27:36 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:36 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:37 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc" returned: 0 in 0.378s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:37 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63" returned: 0 in 0.434s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:37 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63 Sep 01 00:27:37 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:37 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc Sep 01 00:27:37 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:37 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f2ed3c4c-399e-468d-9cd3-0c147a183a63" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:37 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc" returned: 1 in 0.401s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_5_trzddc' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97e923-955c-40d0-a7f7-533a77a3226e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "cinder-quobyte-f2ed3c4c-399e-468d-9cd3-0c147a183a63" released by "delete_volume" :: held 0.824s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Created reservations ['28e6eb51-800b-49f6-ba24-141cb0fe52a6', 'da69fe75-6e93-4d77-adb8-120b205103c5', '529186c3-0a2b-446b-83ad-416c19bbca88', '92de78f7-a6a4-428f-9924-0b083979ac7a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:37 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD Sep 01 00:27:37 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-d351f76b-4b47-4726-85de-abc2bdab7bcd req-f76cbc2e-489a-4a56-b6af-b56ea4ef961c tempest-TestServerVolumeAttachmentScenario-351257321 None] Terminate volume connection completed successfully. Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-d351f76b-4b47-4726-85de-abc2bdab7bcd req-f76cbc2e-489a-4a56-b6af-b56ea4ef961c tempest-TestServerVolumeAttachmentScenario-351257321 None] Deleting attachment 1434e201-992d-4939-9d3e-1ee3b6c98861. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:37 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:37 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:37 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] df40e229-b455-4243-a6fd-53ca30610169 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:27:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:37 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 Sep 01 00:27:37 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:38 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.374s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:38 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Deleted volume successfully. Sep 01 00:27:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a1a4abe8-8080-4b85-b3e4-595432c7030a tempest-VolumesCloneNegativeTest-1557105922 None] Lock "cinder-f2ed3c4c-399e-468d-9cd3-0c147a183a63-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-90c71a1f-3f73-4ec5-9947-7c37a090bc6a req-f341df64-23ca-4e9b-9f48-be3b637824ed tempest-TestServerVolumeAttachmentScenario-351257321 None] Terminate volume connection completed successfully. Sep 01 00:27:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-90c71a1f-3f73-4ec5-9947-7c37a090bc6a req-f341df64-23ca-4e9b-9f48-be3b637824ed tempest-TestServerVolumeAttachmentScenario-351257321 None] Deleting attachment 38550dd0-c181-443b-86ba-e2d195ccb8ed. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:27:40 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9" returned: 0 in 2.564s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:40 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_6_82v89odevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:27:40 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Converted 112.00 MB image at 43.66 MB/s Sep 01 00:27:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:40 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1G Sep 01 00:27:40 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:41 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 1G" returned: 0 in 0.688s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Downloaded image df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume 8016160a-238d-4616-bbbe-ccd45e68c9e9 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 for user c77bf60491b845339f9b2a89fbcff648 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Marking volume 8016160a-238d-4616-bbbe-ccd45e68c9e9 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Copying metadata from image df40e229-b455-4243-a6fd-53ca30610169 to 8016160a-238d-4616-bbbe-ccd45e68c9e9. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Creating volume glance metadata for volume 8016160a-238d-4616-bbbe-ccd45e68c9e9 backed by image df40e229-b455-4243-a6fd-53ca30610169 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce51394-2bde-48e3-9a95-e14b393ffa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8016160a-238d-4616-bbbe-ccd45e68c9e9', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ace1d2-f282-4ccb-9c23-cb6b213f0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Volume volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 (8016160a-238d-4616-bbbe-ccd45e68c9e9): created successfully Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ace1d2-f282-4ccb-9c23-cb6b213f0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Flow 'volume_create_manager' (58e520d7-578b-40e4-8ee0-15d0d6718c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-30791a4f-57cf-47a8-b5d9-f9481253c108 tempest-TestShelveInstance-1700089868 None] Created volume successfully. Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Flow 'volume_create_manager' (f274bbee-e16b-4070-a92a-73089ad3ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007057b6-9d04-4fb5-a5e3-fe7dbce42505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007057b6-9d04-4fb5-a5e3-fe7dbce42505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-314903341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a6b5af-97f2-4556-a5c4-478893a11165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594c499fb85e43fbae7d2a980e6ef1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:43Z,use_quota=True,user_id='d5a8291e1b844fae82173b74a646e2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deed5012-54f1-42df-b1d1-9935678a9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deed5012-54f1-42df-b1d1-9935678a9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca468dc-8490-4751-91e5-a948113f34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca468dc-8490-4751-91e5-a948113f34c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3a6b5af-97f2-4556-a5c4-478893a11165', 'volume_name': 'volume-b3a6b5af-97f2-4556-a5c4-478893a11165', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffcb2fd-73fb-4ab9-8ad5-e191af2e46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffcb2fd-73fb-4ab9-8ad5-e191af2e46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc42107-2372-42e2-8574-7d0f9a98acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Volume b3a6b5af-97f2-4556-a5c4-478893a11165: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3a6b5af-97f2-4556-a5c4-478893a11165', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 00:27:42 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Trying to clone b3a6b5af-97f2-4556-a5c4-478893a11165 from image df40e229-b455-4243-a6fd-53ca30610169 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:27:43 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:27:43 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Image download 20.69 MB at 20.69 MB/s Sep 01 00:27:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb0fb6-eba5-4ee3-a9d5-ec0572988a3e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:43 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD Sep 01 00:27:43 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:44 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 is fetched for user d5a8291e1b844fae82173b74a646e2fd. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdc097-db0b-4216-bec8-594f29072c48]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:44 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD Sep 01 00:27:44 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:44 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-314903341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a6b5af-97f2-4556-a5c4-478893a11165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594c499fb85e43fbae7d2a980e6ef1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:43Z,use_quota=True,user_id='d5a8291e1b844fae82173b74a646e2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Creating volume b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:44 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:44 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1073741824 Sep 01 00:27:44 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:45 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1073741824" returned: 0 in 0.632s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=87,cinder:SELECT=74,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=85,cinder:UPDATE=91,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:45 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 Sep 01 00:27:45 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:45 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Attempting download of df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume b3a6b5af-97f2-4556-a5c4-478893a11165. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-9a907973-d7fa-4c9e-9b72-02da4311e6d0 req-957ec1cf-0ad7-45de-bbf5-0660d496faee tempest-TestShelveInstance-1700089868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-9a907973-d7fa-4c9e-9b72-02da4311e6d0 req-957ec1cf-0ad7-45de-bbf5-0660d496faee tempest-TestShelveInstance-1700089868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-9a907973-d7fa-4c9e-9b72-02da4311e6d0 req-957ec1cf-0ad7-45de-bbf5-0660d496faee tempest-TestShelveInstance-1700089868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbba0c3-869d-4cb4-bbf5-a77bff04f071]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-9a907973-d7fa-4c9e-9b72-02da4311e6d0 req-957ec1cf-0ad7-45de-bbf5-0660d496faee tempest-TestShelveInstance-1700089868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-8016160a-238d-4616-bbbe-ccd45e68c9e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '579cba8f-07e8-4f7b-a618-8c2ac730b5a9', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:27:46 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w Sep 01 00:27:46 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-9a907973-d7fa-4c9e-9b72-02da4311e6d0 req-957ec1cf-0ad7-45de-bbf5-0660d496faee tempest-TestShelveInstance-1700089868 None] attachment_update completed successfully. Sep 01 00:27:46 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w" returned: 0 in 0.463s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:46 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w Sep 01 00:27:46 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "cinder-04207770-7f47-44c6-9ea5-c6b78cd7b407-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-04207770-7f47-44c6-9ea5-c6b78cd7b407-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "cinder-quobyte-04207770-7f47-44c6-9ea5-c6b78cd7b407" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-quobyte-04207770-7f47-44c6-9ea5-c6b78cd7b407" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:46 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w" returned: 1 in 0.476s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df40e229-b455-4243-a6fd-53ca30610169_54a6m44w' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e8d528-d11b-45fe-9ac9-44038f83c9e1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[92759871-ffff-4743-a349-08654d23067f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:47 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD Sep 01 00:27:47 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:47 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 Sep 01 00:27:47 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:47 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] df40e229-b455-4243-a6fd-53ca30610169 was qcow2, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:47 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 Sep 01 00:27:47 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:47 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407" returned: 0 in 0.491s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:47 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407 Sep 01 00:27:47 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:47 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-04207770-7f47-44c6-9ea5-c6b78cd7b407" returned: 0 in 0.342s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-quobyte-04207770-7f47-44c6-9ea5-c6b78cd7b407" released by "delete_volume" :: held 0.898s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Created reservations ['8f9e95b9-10c3-4296-9fbb-ae9af3586524', 'ac94bd24-5747-45f6-994a-e6fa7f978e1e', '520de9c5-ae7d-4574-952a-acd4f1585c93', '636ea934-b0e2-492d-8b2c-a3b8b4c50ec6'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:48 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:48 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "cinder-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "cinder-quobyte-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-quobyte-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc49e22e-44b1-4a16-8ea4-f5a88f6abd9e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:48 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.499s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Deleted volume successfully. Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2385ccc-13f0-469e-a208-9504ddb1fb19 tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-04207770-7f47-44c6-9ea5-c6b78cd7b407-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:48 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda Sep 01 00:27:48 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:48 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" returned: 0 in 0.659s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:48 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda Sep 01 00:27:48 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:49 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-quobyte-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda" released by "delete_volume" :: held 1.309s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Created reservations ['72576c4a-1fec-41d9-9be2-64c40ab4fd88', 'e2b418d1-dd9e-4370-b189-e1465cc515c8', '0e4ad4ef-d0aa-4020-ac28-97322b63fff6', '11ea0a22-2860-40cf-89a9-2c1fea01fa67'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:49 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:49 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:50 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.766s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Deleted volume successfully. Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4975e7a4-800b-4ca9-88e7-e309be76f7da tempest-TestServerVolumeAttachmentScenario-351257321 None] Lock "cinder-fa1a1e2b-cae6-4791-9ef2-5ea26b19dfda-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:50 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165" returned: 0 in 3.413s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df40e229-b455-4243-a6fd-53ca30610169_kxl__7jhdevstack@QuobyteHD, size 112.00 MB, duration 3.42 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:27:50 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Converted 112.00 MB image at 32.78 MB/s Sep 01 00:27:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:50 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1G Sep 01 00:27:50 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 1G" returned: 0 in 0.771s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Downloaded image df40e229-b455-4243-a6fd-53ca30610169 ((None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}])) to volume b3a6b5af-97f2-4556-a5c4-478893a11165 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:27:51 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Temporary image df40e229-b455-4243-a6fd-53ca30610169 for user d5a8291e1b844fae82173b74a646e2fd is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Marking volume b3a6b5af-97f2-4556-a5c4-478893a11165 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Copying metadata from image df40e229-b455-4243-a6fd-53ca30610169 to b3a6b5af-97f2-4556-a5c4-478893a11165. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Creating volume glance metadata for volume b3a6b5af-97f2-4556-a5c4-478893a11165 backed by image df40e229-b455-4243-a6fd-53ca30610169 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc42107-2372-42e2-8574-7d0f9a98acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a6b5af-97f2-4556-a5c4-478893a11165', 'volume_size': 1, 'image_id': 'df40e229-b455-4243-a6fd-53ca30610169', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df40e229-b455-4243-a6fd-53ca30610169', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0d37ad08c4249498ad03cbaada6e939', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df40e229-b455-4243-a6fd-53ca30610169', 'created_at': datetime.datetime(2026, 8, 31, 22, 10, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 10, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df40e229-b455-4243-a6fd-53ca30610169/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d55b706-be12-4810-bfc9-6e6ea2af241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:51 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Volume volume-b3a6b5af-97f2-4556-a5c4-478893a11165 (b3a6b5af-97f2-4556-a5c4-478893a11165): created successfully Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d55b706-be12-4810-bfc9-6e6ea2af241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Flow 'volume_create_manager' (f274bbee-e16b-4070-a92a-73089ad3ed77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c30fec3e-d84d-4375-a3d0-3120a5519522 tempest-VolumesExtendTest-763414654 None] Created volume successfully. Sep 01 00:27:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd18070-2cc9-4051-9d28-ca4a5e59e60c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:53 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 Sep 01 00:27:53 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:53 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165" returned: 0 in 0.681s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 2G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 2G" returned: 0 in 0.176s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.891s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:53 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3b8ec106-2966-4abb-ad39-e1aa9d2a5db5 tempest-VolumesExtendTest-763414654 None] Extend volume completed successfully. Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-b3a6b5af-97f2-4556-a5c4-478893a11165-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "cinder-b3a6b5af-97f2-4556-a5c4-478893a11165-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-quobyte-b3a6b5af-97f2-4556-a5c4-478893a11165" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-b3a6b5af-97f2-4556-a5c4-478893a11165" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d2c44-0cd1-425e-89a8-10aacf981918]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:27:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:54 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 Sep 01 00:27:54 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:55 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165" returned: 0 in 0.636s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:55 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165 Sep 01 00:27:55 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:55 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b3a6b5af-97f2-4556-a5c4-478893a11165" returned: 0 in 0.519s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-b3a6b5af-97f2-4556-a5c4-478893a11165" released by "delete_volume" :: held 1.217s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Created reservations ['c6a0eb7f-bdd2-46c4-a55b-941c5016d868', '657d9885-d010-47aa-a2b1-4fea2c692b59', '0d2f4053-d36b-44a8-a7f4-b225f649cc5d', '04a6ac38-6207-4629-8c94-af0397b7c2a4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:56 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:27:56 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:56 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.668s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:27:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Deleted volume successfully. Sep 01 00:27:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e55b5c2a-0795-4d02-a140-3f18dee11f53 tempest-VolumesExtendTest-763414654 None] Lock "cinder-b3a6b5af-97f2-4556-a5c4-478893a11165-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Flow 'volume_create_manager' (3ffd9fad-8f16-43b6-b7bc-9c10ed47b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93661686-4e24-460b-85e2-eb9564986aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93661686-4e24-460b-85e2-eb9564986aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822131920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f5725e-c4a7-4557-ab6b-74708a58e746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594c499fb85e43fbae7d2a980e6ef1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:58Z,use_quota=True,user_id='d5a8291e1b844fae82173b74a646e2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0072e8c-8e83-49dd-be30-2ab01ccab1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0072e8c-8e83-49dd-be30-2ab01ccab1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f4572-5898-4116-bc50-9b47785675cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f4572-5898-4116-bc50-9b47785675cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f5725e-c4a7-4557-ab6b-74708a58e746', 'volume_name': 'volume-f8f5725e-c4a7-4557-ab6b-74708a58e746', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9e5254-2bde-4138-950d-7205f0f97543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9e5254-2bde-4138-950d-7205f0f97543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0697bd0-df72-4440-afbd-0272b6c55dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:58 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Volume f8f5725e-c4a7-4557-ab6b-74708a58e746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f5725e-c4a7-4557-ab6b-74708a58e746', 'volume_size': 1} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822131920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f5725e-c4a7-4557-ab6b-74708a58e746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594c499fb85e43fbae7d2a980e6ef1b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:27:58Z,use_quota=True,user_id='d5a8291e1b844fae82173b74a646e2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Creating volume f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:27:58 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:27:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:58 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 1073741824 Sep 01 00:27:58 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:59 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 1073741824" returned: 0 in 0.981s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:27:59 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:27:59 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:27:59 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.600s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0697bd0-df72-4440-afbd-0272b6c55dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f5725e-c4a7-4557-ab6b-74708a58e746', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbfed9c-f944-4e66-a621-5492f11a01a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:27:59 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Volume volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 (f8f5725e-c4a7-4557-ab6b-74708a58e746): created successfully Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbfed9c-f944-4e66-a621-5492f11a01a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:27:59 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Flow 'volume_create_manager' (3ffd9fad-8f16-43b6-b7bc-9c10ed47b018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:27:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-942dcbd4-7475-43b2-a7a0-16d621d25fb1 tempest-VolumesExtendTest-763414654 None] Created volume successfully. Sep 01 00:28:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Creating offline snapshot 45fe15a1-8023-40a2-a9e6-5f9f446bc23a of volume f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:28:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[976064d3-1368-4f92-9481-99ad1b9da512]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:01 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:28:01 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:02 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.808s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:02 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a 1G Sep 01 00:28:02 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:03 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a 1G" returned: 0 in 0.788s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:03 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a Sep 01 00:28:03 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:04 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a" returned: 0 in 0.868s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a is being set with open permissions: ugo+rw Sep 01 00:28:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:04 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a Sep 01 00:28:04 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:04 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a" returned: 0 in 0.443s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:04 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info Sep 01 00:28:04 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:05 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info" returned: 0 in 0.550s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:05 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info is being set with open permissions: ugo+rw Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:05 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info Sep 01 00:28:05 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Flow 'volume_create_manager' (e88f9d08-8e38-4311-808c-d0be8f91e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d319ffba-003e-4b66-b87a-99e5fba6b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d319ffba-003e-4b66-b87a-99e5fba6b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-126169416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be6ba01-773e-46dd-8551-894f6f5ac577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a33eb4a344c1c9368540c8b07fd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:05Z,use_quota=True,user_id='2f071b848e1f4f5787e9bf7388052d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f959c5-9b9e-45a7-b9d4-2c134d2302dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f959c5-9b9e-45a7-b9d4-2c134d2302dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc57677-5329-4757-9cf3-6fed5c1714f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc57677-5329-4757-9cf3-6fed5c1714f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be6ba01-773e-46dd-8551-894f6f5ac577', 'volume_name': 'volume-3be6ba01-773e-46dd-8551-894f6f5ac577', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8b9c3d-7399-43ed-8427-fd9dcba5c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8b9c3d-7399-43ed-8427-fd9dcba5c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88169c7-dd04-46a4-bc8f-13688f09ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Volume 3be6ba01-773e-46dd-8551-894f6f5ac577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be6ba01-773e-46dd-8551-894f6f5ac577', 'volume_size': 1} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:05 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.info" returned: 0 in 0.506s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.184s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-126169416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be6ba01-773e-46dd-8551-894f6f5ac577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a33eb4a344c1c9368540c8b07fd50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:05Z,use_quota=True,user_id='2f071b848e1f4f5787e9bf7388052d8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Creating volume 3be6ba01-773e-46dd-8551-894f6f5ac577 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:05 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:05 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 1073741824 Sep 01 00:28:05 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3c0fe149-363e-4b36-8d59-a7a9253213f3 tempest-VolumesExtendTest-763414654 None] Create snapshot completed successfully Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:06 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 1073741824" returned: 0 in 0.603s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:06 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 Sep 01 00:28:06 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:06 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577" returned: 0 in 0.253s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.505s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2e20da-482b-4cfd-b62d-5b4fc36e751f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88169c7-dd04-46a4-bc8f-13688f09ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be6ba01-773e-46dd-8551-894f6f5ac577', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2bf1d4-ce5a-400d-922e-bd26cd572ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:06 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Volume volume-3be6ba01-773e-46dd-8551-894f6f5ac577 (3be6ba01-773e-46dd-8551-894f6f5ac577): created successfully Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2bf1d4-ce5a-400d-922e-bd26cd572ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Flow 'volume_create_manager' (e88f9d08-8e38-4311-808c-d0be8f91e494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-521e70a4-7a54-41fb-a057-736e2fc916c4 tempest-TestMinimumBasicScenario-1142719744 None] Created volume successfully. Sep 01 00:28:07 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:28:07 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:07 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.794s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a 2G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a 2G" returned: 0 in 0.224s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.083s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-35c4177b-6292-40ea-8465-d7480066bdea tempest-VolumesExtendTest-763414654 None] Extend volume completed successfully. Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-45fe15a1-8023-40a2-a9e6-5f9f446bc23a-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-45fe15a1-8023-40a2-a9e6-5f9f446bc23a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-quobyte-45fe15a1-8023-40a2-a9e6-5f9f446bc23a" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-45fe15a1-8023-40a2-a9e6-5f9f446bc23a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Deleting offline snapshot 45fe15a1-8023-40a2-a9e6-5f9f446bc23a of volume f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] snapshot_file for this snap is: volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[88820242-bc21-421b-9f47-d29af4ec69f3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:09 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a Sep 01 00:28:09 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:09 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a" returned: 0 in 0.777s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8f5725e-c4a7-4557-ab6b-74708a58e746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b021f1-ff4c-4375-b883-2eda047e23c8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-faad5b03-8e34-44e6-b53a-2234bcdbcd9f req-c43ee5ca-56b5-42a1-89e0-912af06938d8 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-faad5b03-8e34-44e6-b53a-2234bcdbcd9f req-c43ee5ca-56b5-42a1-89e0-912af06938d8 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-faad5b03-8e34-44e6-b53a-2234bcdbcd9f req-c43ee5ca-56b5-42a1-89e0-912af06938d8 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-faad5b03-8e34-44e6-b53a-2234bcdbcd9f req-c43ee5ca-56b5-42a1-89e0-912af06938d8 tempest-TestMinimumBasicScenario-1142719744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-3be6ba01-773e-46dd-8551-894f6f5ac577', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7c9c87c-a996-422b-a514-d0140ddfe07e', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:28:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-faad5b03-8e34-44e6-b53a-2234bcdbcd9f req-c43ee5ca-56b5-42a1-89e0-912af06938d8 tempest-TestMinimumBasicScenario-1142719744 None] attachment_update completed successfully. Sep 01 00:28:09 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:28:09 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:10 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.793s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:10 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a Sep 01 00:28:10 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:11 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a" returned: 0 in 0.745s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:11 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a Sep 01 00:28:11 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:11 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746.45fe15a1-8023-40a2-a9e6-5f9f446bc23a" returned: 0 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-45fe15a1-8023-40a2-a9e6-5f9f446bc23a" released by "_delete_snapshot" :: held 2.854s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" released by "delete_snapshot" :: held 2.889s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Created reservations ['ce56e644-e6c0-4d05-99d8-e4e8d10275e1', 'f6f6a5a4-3ff0-4a76-9c69-fb0affd747e9', 'c7b71a92-173c-40a2-b973-70897e9011ec', '743911bb-bfa5-4a64-981a-375009452ab9'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Delete snapshot completed successfully. Sep 01 00:28:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-666ebb8f-28b2-4d08-b60d-1ce0afe9247a tempest-VolumesExtendTest-763414654 None] Lock "cinder-45fe15a1-8023-40a2-a9e6-5f9f446bc23a-delete_snapshot" released by "delete_snapshot" :: held 3.136s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-f8f5725e-c4a7-4557-ab6b-74708a58e746-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "cinder-f8f5725e-c4a7-4557-ab6b-74708a58e746-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Acquiring lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb3173-663e-4941-bd14-bd1d09f31a23]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:12 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:28:12 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:12 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.504s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:12 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746 Sep 01 00:28:12 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:13 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f8f5725e-c4a7-4557-ab6b-74708a58e746" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "cinder-quobyte-f8f5725e-c4a7-4557-ab6b-74708a58e746" released by "delete_volume" :: held 1.034s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Created reservations ['5050b6a4-949a-436c-b935-811e05715fb9', '058f99d7-a052-4169-a6b2-e629e74dc3d5', '7452cad2-8465-430a-8d20-52bda769d04b', 'bdecae6c-75d8-41b8-b732-c5f001c319c2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:13 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:13 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:13 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:13 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:13 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.273s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Deleted volume successfully. Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a4c9341f-78b3-4811-b227-62344dfb1a70 tempest-VolumesExtendTest-763414654 None] Lock "cinder-f8f5725e-c4a7-4557-ab6b-74708a58e746-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:13 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.303s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:28:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Flow 'volume_create_manager' (f0ee758b-bd41-4db3-8cd3-51d683e6deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc1547-1178-46b6-8d9e-53ee247f7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc1547-1178-46b6-8d9e-53ee247f7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd081d8-74f4-43a2-baa0-434dd8f475ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da16c40de2c5452fb8aa51daa4f9485d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:18Z,use_quota=True,user_id='28ec576adf2a4562ad9f0d6214160dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c1cb880-480e-48c3-9d9a-311b420e771e),volume_type_id=9c1cb880-480e-48c3-9d9a-311b420e771e)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c88ebc-33a2-44e2-a5f6-07588dd7945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c88ebc-33a2-44e2-a5f6-07588dd7945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28511ac-df11-4ab0-80ba-ec04bb3253be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (05f85d0a-5640-4af6-aa67-256d14e49c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87258adb-afc3-46a9-83e4-d488f216c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87258adb-afc3-46a9-83e4-d488f216c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533417279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4625d14-cd95-406d-b4b5-f0d536ad0f01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:18Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facf97cf-818c-4916-82ab-79dddd1e1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facf97cf-818c-4916-82ab-79dddd1e1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17c630b-4f8c-4bc8-89de-94a35112a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17c630b-4f8c-4bc8-89de-94a35112a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4625d14-cd95-406d-b4b5-f0d536ad0f01', 'volume_name': 'volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47811c-27d4-4eee-86b9-1c2f9096f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47811c-27d4-4eee-86b9-1c2f9096f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd505ff-692f-453a-9ca6-ac2544f498c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Volume f4625d14-cd95-406d-b4b5-f0d536ad0f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01', 'volume_size': 1} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1533417279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4625d14-cd95-406d-b4b5-f0d536ad0f01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:18Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Creating volume f4625d14-cd95-406d-b4b5-f0d536ad0f01 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:18 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:18 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 1073741824 Sep 01 00:28:18 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28511ac-df11-4ab0-80ba-ec04bb3253be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abd081d8-74f4-43a2-baa0-434dd8f475ef', 'volume_name': 'volume-abd081d8-74f4-43a2-baa0-434dd8f475ef', 'volume_size': 1, 'image_id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca5ac6402621ae4ee5653e4a2ffea58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da16c40de2c5452fb8aa51daa4f9485d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1325d930daceeb860c6b7f5100a3218ed18ccaa3cc69158a575783810fa2620705ed6a4d9e17c12e2ef7fa7b0a59c51b0e65511fc870fb3329a3f4537ea2e331', 'id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'created_at': datetime.datetime(2026, 8, 31, 22, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac115bc-6e7d-4772-aa93-1f6bd8f2088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac115bc-6e7d-4772-aa93-1f6bd8f2088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275c477a-23c4-43b7-b78f-50e14edfac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:18 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Volume abd081d8-74f4-43a2-baa0-434dd8f475ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abd081d8-74f4-43a2-baa0-434dd8f475ef', 'volume_size': 1, 'image_id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca5ac6402621ae4ee5653e4a2ffea58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da16c40de2c5452fb8aa51daa4f9485d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1325d930daceeb860c6b7f5100a3218ed18ccaa3cc69158a575783810fa2620705ed6a4d9e17c12e2ef7fa7b0a59c51b0e65511fc870fb3329a3f4537ea2e331', 'id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'created_at': datetime.datetime(2026, 8, 31, 22, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Trying to clone abd081d8-74f4-43a2-baa0-434dd8f475ef from image 04d400d7-bd54-4ab3-a5fd-54286d904a6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:28:18 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Image download 0.00 MB at 0.00 MB/s Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ab2fe1-a972-45f3-9b75-45f857dcf0b3]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:18 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 1073741824" returned: 0 in 0.555s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:18 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:18 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:19 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 Sep 01 00:28:19 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:19 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:19 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd505ff-692f-453a-9ca6-ac2544f498c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5221ce72-1dc9-4b9f-a31f-ea4679b88ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Volume volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 (f4625d14-cd95-406d-b4b5-f0d536ad0f01): created successfully Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5221ce72-1dc9-4b9f-a31f-ea4679b88ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (05f85d0a-5640-4af6-aa67-256d14e49c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2e6fb50f-9cd8-4608-98b5-de6b640949fa tempest-VolumesListTestJSON-577564540 None] Created volume successfully. Sep 01 00:28:19 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:19 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:19 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Temporary image 04d400d7-bd54-4ab3-a5fd-54286d904a6f is fetched for user 28ec576adf2a4562ad9f0d6214160dc8. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1819afd4-eaab-4a6f-801a-5445afe07fd9]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:19 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:19 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:20 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:20 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:20 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:20 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 1 in 0.540s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd081d8-74f4-43a2-baa0-434dd8f475ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da16c40de2c5452fb8aa51daa4f9485d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:18Z,use_quota=True,user_id='28ec576adf2a4562ad9f0d6214160dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c1cb880-480e-48c3-9d9a-311b420e771e),volume_type_id=9c1cb880-480e-48c3-9d9a-311b420e771e)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Creating volume abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:20 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:20 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1073741824 Sep 01 00:28:20 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (fe7313ef-cabb-4b1f-9569-694595621b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fafee4-77d9-4a14-8004-452c53b7ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fafee4-77d9-4a14-8004-452c53b7ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-352610082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9e3384-1edb-4650-836e-5ac792d32f0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:21Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b1f967-bc95-43a6-bfb0-148380abd9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b1f967-bc95-43a6-bfb0-148380abd9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d4f71-56b8-4b43-8cbc-d4579fb4bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814d4f71-56b8-4b43-8cbc-d4579fb4bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9e3384-1edb-4650-836e-5ac792d32f0c', 'volume_name': 'volume-0d9e3384-1edb-4650-836e-5ac792d32f0c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4013b-de16-4a80-b9ec-cf545f96c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4013b-de16-4a80-b9ec-cf545f96c68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877ae04d-7a15-44be-8033-d5e82579502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Volume 0d9e3384-1edb-4650-836e-5ac792d32f0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9e3384-1edb-4650-836e-5ac792d32f0c', 'volume_size': 1} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:21 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1073741824" returned: 0 in 0.594s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:21 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef Sep 01 00:28:21 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:21 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef" returned: 0 in 0.304s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-352610082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9e3384-1edb-4650-836e-5ac792d32f0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:21Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Creating volume 0d9e3384-1edb-4650-836e-5ac792d32f0c {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:21 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:21 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c 1073741824 Sep 01 00:28:21 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Attempting download of 04d400d7-bd54-4ab3-a5fd-54286d904a6f ((None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}])) to volume abd081d8-74f4-43a2-baa0-434dd8f475ef. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[407dbff6-44d4-4bb9-ac97-3250e4c9fa80]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:21 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8 Sep 01 00:28:21 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:22 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c 1073741824" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:22 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c Sep 01 00:28:22 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:22 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8" returned: 0 in 0.405s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:22 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8 Sep 01 00:28:22 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:22 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877ae04d-7a15-44be-8033-d5e82579502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9e3384-1edb-4650-836e-5ac792d32f0c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2643c6-f7ae-48cc-944b-985446059984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Volume volume-0d9e3384-1edb-4650-836e-5ac792d32f0c (0d9e3384-1edb-4650-836e-5ac792d32f0c): created successfully Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2643c6-f7ae-48cc-944b-985446059984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (fe7313ef-cabb-4b1f-9569-694595621b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-53e6f94a-ed9f-4f48-95d6-4efba786e91c tempest-VolumesListTestJSON-577564540 None] Created volume successfully. Sep 01 00:28:22 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8" returned: 1 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04d400d7-bd54-4ab3-a5fd-54286d904a6f_h49l_gm8' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b20c0-8c67-4ee3-a37a-4afb09fe7168]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:22 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:22 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:23 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:23 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD Sep 01 00:28:23 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:23 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] 04d400d7-bd54-4ab3-a5fd-54286d904a6f was raw, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:28:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:23 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef Sep 01 00:28:23 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (be09ee62-f264-481e-a585-103f0970c58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c560016-a75d-496c-a059-3201165e76d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c560016-a75d-496c-a059-3201165e76d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17056180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0b2f64-91f3-4458-b6e9-c82714aea6b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:24Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412a4e4-b4c7-4cc9-911e-ba3de208c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0412a4e4-b4c7-4cc9-911e-ba3de208c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8061fb-71ed-4bd0-aea0-35d6cf7bf06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8061fb-71ed-4bd0-aea0-35d6cf7bf06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0b2f64-91f3-4458-b6e9-c82714aea6b4', 'volume_name': 'volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c408f6d3-1d7e-4d76-b6f8-e08b9159fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c408f6d3-1d7e-4d76-b6f8-e08b9159fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bbf1cb-d9f6-4079-bcf5-0420749c1a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Volume ab0b2f64-91f3-4458-b6e9-c82714aea6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4', 'volume_size': 1} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17056180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0b2f64-91f3-4458-b6e9-c82714aea6b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab1522abde574604a0d6b8c8ce57357e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:24Z,use_quota=True,user_id='ce7b845558b44789b0bce8aa45dc5971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Creating volume ab0b2f64-91f3-4458-b6e9-c82714aea6b4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:24 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:24 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 1073741824 Sep 01 00:28:24 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:24 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef" returned: 0 in 0.745s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04d400d7-bd54-4ab3-a5fd-54286d904a6f_1rgpjg9ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:28:24 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 00:28:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:24 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1G Sep 01 00:28:24 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:25 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 1073741824" returned: 0 in 0.666s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:25 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef 1G" returned: 0 in 0.530s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Downloaded image 04d400d7-bd54-4ab3-a5fd-54286d904a6f ((None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}])) to volume abd081d8-74f4-43a2-baa0-434dd8f475ef successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Temporary image 04d400d7-bd54-4ab3-a5fd-54286d904a6f for user 28ec576adf2a4562ad9f0d6214160dc8 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Marking volume abd081d8-74f4-43a2-baa0-434dd8f475ef as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Copying metadata from image 04d400d7-bd54-4ab3-a5fd-54286d904a6f to abd081d8-74f4-43a2-baa0-434dd8f475ef. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Creating volume glance metadata for volume abd081d8-74f4-43a2-baa0-434dd8f475ef backed by image 04d400d7-bd54-4ab3-a5fd-54286d904a6f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1ca5ac6402621ae4ee5653e4a2ffea58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:28:25 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 Sep 01 00:28:25 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275c477a-23c4-43b7-b78f-50e14edfac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd081d8-74f4-43a2-baa0-434dd8f475ef', 'volume_size': 1, 'image_id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ca5ac6402621ae4ee5653e4a2ffea58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da16c40de2c5452fb8aa51daa4f9485d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1325d930daceeb860c6b7f5100a3218ed18ccaa3cc69158a575783810fa2620705ed6a4d9e17c12e2ef7fa7b0a59c51b0e65511fc870fb3329a3f4537ea2e331', 'id': '04d400d7-bd54-4ab3-a5fd-54286d904a6f', 'created_at': datetime.datetime(2026, 8, 31, 22, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04d400d7-bd54-4ab3-a5fd-54286d904a6f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8b772a-25a9-4b56-a676-d2daeaf5eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Volume volume-abd081d8-74f4-43a2-baa0-434dd8f475ef (abd081d8-74f4-43a2-baa0-434dd8f475ef): created successfully Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8b772a-25a9-4b56-a676-d2daeaf5eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Flow 'volume_create_manager' (f0ee758b-bd41-4db3-8cd3-51d683e6deb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-886aa46b-315b-4975-9058-2b769ef9006f tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Created volume successfully. Sep 01 00:28:25 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" returned: 0 in 0.348s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bbf1cb-d9f6-4079-bcf5-0420749c1a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891fab54-92d0-4321-929a-31b317df148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Volume volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 (ab0b2f64-91f3-4458-b6e9-c82714aea6b4): created successfully Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891fab54-92d0-4321-929a-31b317df148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Flow 'volume_create_manager' (be09ee62-f264-481e-a585-103f0970c58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c50f89cf-fb4a-4702-9d1f-f26d705a31f3 tempest-VolumesListTestJSON-577564540 None] Created volume successfully. Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Acquiring lock "cinder-abd081d8-74f4-43a2-baa0-434dd8f475ef-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "cinder-abd081d8-74f4-43a2-baa0-434dd8f475ef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Acquiring lock "cinder-quobyte-abd081d8-74f4-43a2-baa0-434dd8f475ef" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "cinder-quobyte-abd081d8-74f4-43a2-baa0-434dd8f475ef" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbdf07-f7c6-4869-97a2-0e75c5337831]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:26 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef Sep 01 00:28:26 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:26 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef" returned: 0 in 0.592s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:26 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef Sep 01 00:28:26 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:26 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-83a719c7-1aef-41dc-b2f4-d456219ffbae req-a51df5ee-8e11-4185-b5b6-04fa3a50dd34 tempest-TestShelveInstance-1700089868 None] Terminate volume connection completed successfully. Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-83a719c7-1aef-41dc-b2f4-d456219ffbae req-a51df5ee-8e11-4185-b5b6-04fa3a50dd34 tempest-TestShelveInstance-1700089868 None] Deleting attachment 579cba8f-07e8-4f7b-a618-8c2ac730b5a9. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:28:26 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-abd081d8-74f4-43a2-baa0-434dd8f475ef" returned: 0 in 0.332s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "cinder-quobyte-abd081d8-74f4-43a2-baa0-434dd8f475ef" released by "delete_volume" :: held 0.973s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:26 devstack cinder-volume[87803]: WARNING cinder.quota [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:28:26 devstack cinder-volume[87803]: WARNING cinder.quota [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 00:28:26 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Created reservations ['b469f8d9-92c2-47d4-9150-d86bfadf2e8b', '542843ca-7119-47f2-98fb-d74f0f7886f3', '261eb0b9-f81d-471f-8cac-32ac308f4354', '1df52685-86e7-462e-95c5-dec581915c3d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:27 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:27 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:27 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Deleted volume successfully. Sep 01 00:28:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-df38d1a3-d892-463e-aa2f-f484c838e8fd tempest-VolumeAndVolumeTypeFromImageTest-1647501022 None] Lock "cinder-abd081d8-74f4-43a2-baa0-434dd8f475ef-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-ab0b2f64-91f3-4458-b6e9-c82714aea6b4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "cinder-ab0b2f64-91f3-4458-b6e9-c82714aea6b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-quobyte-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb909f1-ff8e-4c24-9ec3-88cb8a8cce88]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:29 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 Sep 01 00:28:29 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:29 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" returned: 0 in 0.716s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:29 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4 Sep 01 00:28:29 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:29 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" returned: 0 in 0.351s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-ab0b2f64-91f3-4458-b6e9-c82714aea6b4" released by "delete_volume" :: held 1.133s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Created reservations ['da042e57-8d6e-40b8-bddf-e91525af82cd', '1a9139a1-a5a9-4dba-b2e8-e41343ac6c00', '1d559080-a69e-4dc4-9f92-c88abc6254a3', '50795799-d7ef-46f9-aa23-fb2f0575b5b1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:30 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:30 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:30 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.447s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Deleted volume successfully. Sep 01 00:28:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b3a4d7d-dbc0-4143-bc99-e5929d50dd6f tempest-VolumesListTestJSON-577564540 None] Lock "cinder-ab0b2f64-91f3-4458-b6e9-c82714aea6b4-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-0d9e3384-1edb-4650-836e-5ac792d32f0c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "cinder-0d9e3384-1edb-4650-836e-5ac792d32f0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-quobyte-0d9e3384-1edb-4650-836e-5ac792d32f0c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-0f4ec748-4a39-4b86-87ff-49ee5ad65ef7 req-b9560437-48a3-4f95-9de3-be85c9afae8b tempest-TestShelveInstance-1700089868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-0f4ec748-4a39-4b86-87ff-49ee5ad65ef7 req-b9560437-48a3-4f95-9de3-be85c9afae8b tempest-TestShelveInstance-1700089868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-0f4ec748-4a39-4b86-87ff-49ee5ad65ef7 req-b9560437-48a3-4f95-9de3-be85c9afae8b tempest-TestShelveInstance-1700089868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-0d9e3384-1edb-4650-836e-5ac792d32f0c" acquired by "delete_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[274afae5-6782-4a8a-abf1-927aeb88fa05]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-0f4ec748-4a39-4b86-87ff-49ee5ad65ef7 req-b9560437-48a3-4f95-9de3-be85c9afae8b tempest-TestShelveInstance-1700089868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-8016160a-238d-4616-bbbe-ccd45e68c9e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e71c7c2-d92c-4192-b782-af93739fc8fe', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:28:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-0f4ec748-4a39-4b86-87ff-49ee5ad65ef7 req-b9560437-48a3-4f95-9de3-be85c9afae8b tempest-TestShelveInstance-1700089868 None] attachment_update completed successfully. Sep 01 00:28:31 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c Sep 01 00:28:31 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:32 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c" returned: 0 in 0.769s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:32 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c Sep 01 00:28:32 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:32 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0d9e3384-1edb-4650-836e-5ac792d32f0c" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-0d9e3384-1edb-4650-836e-5ac792d32f0c" released by "delete_volume" :: held 1.217s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Created reservations ['3675e893-76a9-4615-a629-6986a0d33c8b', 'c54e9ebb-f715-4ec6-a869-7683d8d38eea', '651a87cb-5320-47ab-be75-cf2491901989', '16c82450-2bad-414d-9d1e-136a6d48bd1e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:32 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:32 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:33 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.356s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Deleted volume successfully. Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a372d4a-236a-4407-8e3a-409b06acb8e3 tempest-VolumesListTestJSON-577564540 None] Lock "cinder-0d9e3384-1edb-4650-836e-5ac792d32f0c-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-f4625d14-cd95-406d-b4b5-f0d536ad0f01-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "cinder-f4625d14-cd95-406d-b4b5-f0d536ad0f01-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Acquiring lock "cinder-quobyte-f4625d14-cd95-406d-b4b5-f0d536ad0f01" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-f4625d14-cd95-406d-b4b5-f0d536ad0f01" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622c2a4-2970-427d-ab8f-a5db877015d4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:33 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 Sep 01 00:28:33 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:34 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01" returned: 0 in 0.536s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:34 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01 Sep 01 00:28:34 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:35 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4625d14-cd95-406d-b4b5-f0d536ad0f01" returned: 0 in 0.757s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "cinder-quobyte-f4625d14-cd95-406d-b4b5-f0d536ad0f01" released by "delete_volume" :: held 1.389s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Created reservations ['f0d23d4d-7528-467c-acdb-ef5813600786', '75ccb91a-29fe-4544-a12d-40a7c814a891', '33e47902-5e30-4a33-b0b3-025ed573f7b8', 'd11889f9-bf5e-442a-a5f2-9e6fdfa44993'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:35 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:35 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:35 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (a285a485-e47c-485a-8ccc-09e24b8f0ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b22e4-ff6c-4e61-95b4-63bcfeef02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4b22e4-ff6c-4e61-95b4-63bcfeef02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514388639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef2ba83-2fe2-4786-8713-0ce98229c0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:36Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68a01d-276d-44d4-99df-c9162ffaff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68a01d-276d-44d4-99df-c9162ffaff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284995c0-86b7-4fa8-833d-a892cd5370e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284995c0-86b7-4fa8-833d-a892cd5370e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef2ba83-2fe2-4786-8713-0ce98229c0af', 'volume_name': 'volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84accf69-5e1b-4c1d-8836-c5e4e485457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84accf69-5e1b-4c1d-8836-c5e4e485457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ad8f47-7a02-49a0-91a5-2fc63fa42915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Volume 8ef2ba83-2fe2-4786-8713-0ce98229c0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af', 'volume_size': 1} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514388639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef2ba83-2fe2-4786-8713-0ce98229c0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:36Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Creating volume 8ef2ba83-2fe2-4786-8713-0ce98229c0af {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:36 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:36 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af 1073741824 Sep 01 00:28:36 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:36 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.747s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Deleted volume successfully. Sep 01 00:28:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-478d9f02-301f-47cf-a7fe-86c57ab8d0ca tempest-VolumesListTestJSON-577564540 None] Lock "cinder-f4625d14-cd95-406d-b4b5-f0d536ad0f01-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:37 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af 1073741824" returned: 0 in 1.000s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:37 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af Sep 01 00:28:37 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (c90cdf14-4e66-4bff-8679-9feaea0503d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce947d6-e25a-4c9a-8470-2bb80ab63264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce947d6-e25a-4c9a-8470-2bb80ab63264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629821992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723fe34-baf7-45c2-9269-728dfb687662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:37Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285570cb-e817-40f3-b6aa-f7f68aa1634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285570cb-e817-40f3-b6aa-f7f68aa1634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed1bbe9-0802-42a1-9592-8f45dc851011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed1bbe9-0802-42a1-9592-8f45dc851011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2723fe34-baf7-45c2-9269-728dfb687662', 'volume_name': 'volume-2723fe34-baf7-45c2-9269-728dfb687662', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8187037-700c-44df-952b-3bc15c70349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8187037-700c-44df-952b-3bc15c70349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646387ae-344e-4a3e-8afc-fbc4caf1a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Volume 2723fe34-baf7-45c2-9269-728dfb687662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2723fe34-baf7-45c2-9269-728dfb687662', 'volume_size': 1} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:37 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af" returned: 0 in 0.644s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-629821992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723fe34-baf7-45c2-9269-728dfb687662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:37Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Creating volume 2723fe34-baf7-45c2-9269-728dfb687662 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:38 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ad8f47-7a02-49a0-91a5-2fc63fa42915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f63b5d1-c715-40e3-826f-c0c6464c5bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 1073741824 Sep 01 00:28:38 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Volume volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af (8ef2ba83-2fe2-4786-8713-0ce98229c0af): created successfully Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f63b5d1-c715-40e3-826f-c0c6464c5bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (a285a485-e47c-485a-8ccc-09e24b8f0ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (dd7c3bee-e4db-4820-9162-7b0387a56f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b066e513-bb27-4c3c-8eee-7718ed741c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-22ee477f-4571-4260-84e7-a7a044ed3cf7 tempest-CreateVolumesFromImageTest-411332854 None] Created volume successfully. Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b066e513-bb27-4c3c-8eee-7718ed741c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497529188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db83d9f-a599-42eb-9473-095815d91ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:38Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e39a094-5359-4d07-97ef-ef7053e840aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e39a094-5359-4d07-97ef-ef7053e840aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da225c7d-3625-4a02-9007-3ef502260843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da225c7d-3625-4a02-9007-3ef502260843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db83d9f-a599-42eb-9473-095815d91ef3', 'volume_name': 'volume-3db83d9f-a599-42eb-9473-095815d91ef3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c7f3b2-e5c5-47b3-89f2-baf92ed11b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c7f3b2-e5c5-47b3-89f2-baf92ed11b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a77fe4-0b4e-40da-81d9-eec1c48eb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Volume 3db83d9f-a599-42eb-9473-095815d91ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db83d9f-a599-42eb-9473-095815d91ef3', 'volume_size': 1} Sep 01 00:28:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:39 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 1073741824" returned: 0 in 1.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:39 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 Sep 01 00:28:39 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (f8353719-03b2-4a18-9ca3-8c0fe24b3911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4499a98d-324f-4839-9975-0788cc6f8368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4499a98d-324f-4839-9975-0788cc6f8368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-784053820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8b3c12-6e1c-4f4f-a9de-ead2618afaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:39Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd62a55f-35a3-4722-a6ce-2a6ef5db396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd62a55f-35a3-4722-a6ce-2a6ef5db396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27179afa-101f-4d9e-bae0-9fed6a3b4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27179afa-101f-4d9e-bae0-9fed6a3b4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8b3c12-6e1c-4f4f-a9de-ead2618afaca', 'volume_name': 'volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806c224-839a-4df9-9ed5-4e572e12f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b806c224-839a-4df9-9ed5-4e572e12f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5eb94f-a292-4b2e-ae6f-144f1b77d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Volume be8b3c12-6e1c-4f4f-a9de-ead2618afaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca', 'volume_size': 1} Sep 01 00:28:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:40 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662" returned: 0 in 0.790s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497529188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db83d9f-a599-42eb-9473-095815d91ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:38Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Creating volume 3db83d9f-a599-42eb-9473-095815d91ef3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:40 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (e9ff048b-4319-4dc8-8a0b-ebecb3e8957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b825e79-60d6-4820-8c09-88fb940ac497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 1073741824 Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646387ae-344e-4a3e-8afc-fbc4caf1a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2723fe34-baf7-45c2-9269-728dfb687662', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a57965-13d5-4105-a91f-9108f8e50f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b825e79-60d6-4820-8c09-88fb940ac497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890013551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b90fd8-e5fc-4644-9a59-fcab5db5eeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:40Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485a5815-e3fa-4a5b-8030-ffda1d46fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485a5815-e3fa-4a5b-8030-ffda1d46fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f8cf13-4fb0-4096-98b9-f743fcf15266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f8cf13-4fb0-4096-98b9-f743fcf15266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b90fd8-e5fc-4644-9a59-fcab5db5eeee', 'volume_name': 'volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8448b23c-6091-49e9-b978-4c98b486aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8448b23c-6091-49e9-b978-4c98b486aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe19a29-a01e-4d10-ac05-28da4048fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Volume e0b90fd8-e5fc-4644-9a59-fcab5db5eeee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee', 'volume_size': 1} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Volume volume-2723fe34-baf7-45c2-9269-728dfb687662 (2723fe34-baf7-45c2-9269-728dfb687662): created successfully Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a57965-13d5-4105-a91f-9108f8e50f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (c90cdf14-4e66-4bff-8679-9feaea0503d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-49e97798-df01-45c6-a1da-72adf7773e02 tempest-CreateVolumesFromImageTest-411332854 None] Created volume successfully. Sep 01 00:28:41 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 1073741824" returned: 0 in 0.770s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:41 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 Sep 01 00:28:41 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:41 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-784053820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8b3c12-6e1c-4f4f-a9de-ead2618afaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:39Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Creating volume be8b3c12-6e1c-4f4f-a9de-ead2618afaca {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a77fe4-0b4e-40da-81d9-eec1c48eb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db83d9f-a599-42eb-9473-095815d91ef3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae13b1e-bf62-4872-9126-c4cdea70abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:41 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca 1073741824 Sep 01 00:28:41 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Volume volume-3db83d9f-a599-42eb-9473-095815d91ef3 (3db83d9f-a599-42eb-9473-095815d91ef3): created successfully Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae13b1e-bf62-4872-9126-c4cdea70abdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (dd7c3bee-e4db-4820-9162-7b0387a56f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7c203dbf-93b6-4223-ba52-a61aac8588e4 tempest-CreateVolumesFromImageTest-411332854 None] Created volume successfully. Sep 01 00:28:42 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca 1073741824" returned: 0 in 0.694s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:42 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca Sep 01 00:28:42 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:42 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890013551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b90fd8-e5fc-4644-9a59-fcab5db5eeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3e612d425414e8d89d123afb8647157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:40Z,use_quota=True,user_id='3f98dc38843543a5b6a62ba420525c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Creating volume e0b90fd8-e5fc-4644-9a59-fcab5db5eeee {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:42 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5eb94f-a292-4b2e-ae6f-144f1b77d2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1966a1b-7e13-46d2-b5bb-f55f6ed93143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:42 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee 1073741824 Sep 01 00:28:42 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Volume volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca (be8b3c12-6e1c-4f4f-a9de-ead2618afaca): created successfully Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1966a1b-7e13-46d2-b5bb-f55f6ed93143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (f8353719-03b2-4a18-9ca3-8c0fe24b3911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6b7c3f0f-48d0-4faf-a649-6b131814020d tempest-CreateVolumesFromImageTest-411332854 None] Created volume successfully. Sep 01 00:28:43 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee 1073741824" returned: 0 in 0.643s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:43 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee Sep 01 00:28:43 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:43 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe19a29-a01e-4d10-ac05-28da4048fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf30e5a2-7f6e-40ac-840f-e8deb18d1e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:43 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Volume volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee (e0b90fd8-e5fc-4644-9a59-fcab5db5eeee): created successfully Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf30e5a2-7f6e-40ac-840f-e8deb18d1e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Flow 'volume_create_manager' (e9ff048b-4319-4dc8-8a0b-ebecb3e8957f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a8503867-ee0a-4fcf-8096-a98a9c96aa6f tempest-CreateVolumesFromImageTest-411332854 None] Created volume successfully. Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-quobyte-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1565bf-bedc-4c64-b255-879f287ce4ac]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:45 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee Sep 01 00:28:45 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:45 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" returned: 0 in 0.468s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:45 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee Sep 01 00:28:45 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:45 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee" released by "delete_volume" :: held 0.772s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=114,cinder:SELECT=114,cinder:INSERT=30,cinder:DELETE=12 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=105,cinder:INSERT=41,cinder:UPDATE=124,cinder:DELETE=9 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:28:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Created reservations ['a75631c5-cc4b-4dad-ba20-1f952f58b8fd', '068cbe87-1721-45da-8559-107b5cf85add', '1176dbfc-4adb-45bc-accc-586783d6fbbb', '422944d6-12cf-4c8f-b62f-a510ed0de1d2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:46 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:46 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-be8b3c12-6e1c-4f4f-a9de-ead2618afaca-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-be8b3c12-6e1c-4f4f-a9de-ead2618afaca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-quobyte-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" acquired by "delete_volume" :: waited 0.040s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ca8df-ba8b-477c-aa34-b7d51a4b921d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:46 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.359s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Deleted volume successfully. Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-60b517f0-9b69-4d50-ab64-aa2128e0b9a1 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-e0b90fd8-e5fc-4644-9a59-fcab5db5eeee-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:46 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca Sep 01 00:28:46 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:46 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" returned: 0 in 0.470s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:46 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca Sep 01 00:28:46 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:47 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-be8b3c12-6e1c-4f4f-a9de-ead2618afaca" released by "delete_volume" :: held 0.783s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Created reservations ['7f7b885f-73c5-4ac4-a14e-4af74499af70', '74598f31-7429-47c6-a1ff-bdb9da5e88b9', '91f39228-be6c-472d-a39d-757006613496', '733bb977-00a8-43ac-b1b8-002f845c15f6'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:47 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:47 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-3db83d9f-a599-42eb-9473-095815d91ef3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-3db83d9f-a599-42eb-9473-095815d91ef3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-quobyte-3db83d9f-a599-42eb-9473-095815d91ef3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-3db83d9f-a599-42eb-9473-095815d91ef3" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:47 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.363s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Deleted volume successfully. Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[651be6ee-2e3a-48a5-82af-2e65ad52fa03]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-113e2b56-4285-4c8c-bd5b-0c9690db0e57 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-be8b3c12-6e1c-4f4f-a9de-ead2618afaca-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:47 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 Sep 01 00:28:47 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:48 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:48 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3 Sep 01 00:28:48 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:48 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3db83d9f-a599-42eb-9473-095815d91ef3" returned: 0 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-3db83d9f-a599-42eb-9473-095815d91ef3" released by "delete_volume" :: held 0.799s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Created reservations ['b56be434-a3c1-4372-98b7-f223e20268d7', '3388a500-4da7-409e-a376-3c677c80f7f5', 'cade4edf-f508-44f9-8f54-bf787ccc3c68', '83ae8bb2-7168-4f94-980c-c4c874e4ae8e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:48 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:48 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-2723fe34-baf7-45c2-9269-728dfb687662-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-2723fe34-baf7-45c2-9269-728dfb687662-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-quobyte-2723fe34-baf7-45c2-9269-728dfb687662" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-2723fe34-baf7-45c2-9269-728dfb687662" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:48 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.366s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[33189d54-170e-4e76-8cce-a8bc2266eef5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Deleted volume successfully. Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d29f4bf-a519-46be-b67a-17d94e224a9a tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-3db83d9f-a599-42eb-9473-095815d91ef3-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:49 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 Sep 01 00:28:49 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:49 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662" returned: 0 in 0.455s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:49 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662 Sep 01 00:28:49 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:49 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2723fe34-baf7-45c2-9269-728dfb687662" returned: 0 in 0.348s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-2723fe34-baf7-45c2-9269-728dfb687662" released by "delete_volume" :: held 0.910s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Created reservations ['beca8394-d661-4adb-92d0-49ff7651cc87', 'c63ccde6-9631-4945-af06-4fe655b53562', '5c3ac1b2-7615-45c5-a0e6-e865636889d7', 'd20a6640-af23-42f7-827a-05961c25c3c3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:50 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:50 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-8ef2ba83-2fe2-4786-8713-0ce98229c0af-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-8ef2ba83-2fe2-4786-8713-0ce98229c0af-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "cinder-quobyte-8ef2ba83-2fe2-4786-8713-0ce98229c0af" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-8ef2ba83-2fe2-4786-8713-0ce98229c0af" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d8cf8b-bd49-447c-aea6-fdfd788d8b92]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:50 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af Sep 01 00:28:50 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:50 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.589s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Deleted volume successfully. Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-56072368-6df3-4e85-b553-f31295f848ca tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-2723fe34-baf7-45c2-9269-728dfb687662-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:50 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af" returned: 0 in 0.611s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:50 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af Sep 01 00:28:50 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:51 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8ef2ba83-2fe2-4786-8713-0ce98229c0af" returned: 0 in 0.426s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-quobyte-8ef2ba83-2fe2-4786-8713-0ce98229c0af" released by "delete_volume" :: held 1.114s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Created reservations ['5615fc75-04ab-4965-bacf-26d7390289f8', '453dbe35-4da3-478a-9bfb-4ec6b7eb83f6', '94c96802-4589-4d7d-917d-63e9b138a127', 'f7f826fe-27aa-4e92-815c-f056f5650ca2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:51 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:28:51 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:52 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.447s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:52 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:28:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Deleted volume successfully. Sep 01 00:28:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-484da901-5cd2-448e-9da2-9c7ebbaf5735 tempest-CreateVolumesFromImageTest-411332854 None] Lock "cinder-8ef2ba83-2fe2-4786-8713-0ce98229c0af-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (f6ae4177-eb67-4a4f-a6a3-938b04d84a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a959a4b-7c99-408b-a30a-d24f023d49a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a959a4b-7c99-408b-a30a-d24f023d49a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847435014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b799ade4-a35d-418c-8aff-2c43065c8f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:54Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f823e5-eed9-4a34-8166-12d9e3bea219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f823e5-eed9-4a34-8166-12d9e3bea219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30648822-736f-4bfd-b7c7-fcad39cd95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30648822-736f-4bfd-b7c7-fcad39cd95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b799ade4-a35d-418c-8aff-2c43065c8f74', 'volume_name': 'volume-b799ade4-a35d-418c-8aff-2c43065c8f74', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c3d0a8-f9c3-435c-827b-3fbc64e48fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c3d0a8-f9c3-435c-827b-3fbc64e48fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49aa3de-82c2-4ce7-ad83-f781995df4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume b799ade4-a35d-418c-8aff-2c43065c8f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b799ade4-a35d-418c-8aff-2c43065c8f74', 'volume_size': 1} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-847435014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b799ade4-a35d-418c-8aff-2c43065c8f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:54Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating volume b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:54 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 1073741824 Sep 01 00:28:54 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:54 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 1073741824" returned: 0 in 0.540s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:55 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 Sep 01 00:28:55 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:55 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49aa3de-82c2-4ce7-ad83-f781995df4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b799ade4-a35d-418c-8aff-2c43065c8f74', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3ee717-acfd-445c-b80f-7eabeff61ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume volume-b799ade4-a35d-418c-8aff-2c43065c8f74 (b799ade4-a35d-418c-8aff-2c43065c8f74): created successfully Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3ee717-acfd-445c-b80f-7eabeff61ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (f6ae4177-eb67-4a4f-a6a3-938b04d84a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-19d06ed5-8c6d-4e3e-8602-669c017fd7a5 tempest-VolumesSnapshotTestJSON-1133226852 None] Created volume successfully. Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Flow 'volume_create_manager' (d0e4baa7-63ce-4f84-ad49-0e30e242b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e7f6f8-34ef-4e95-87c4-f48c310dbae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e7f6f8-34ef-4e95-87c4-f48c310dbae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868641554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6d7f06-353b-49f9-b416-68a227eaa288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759970655b004948bda723f831dc30da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:56Z,use_quota=True,user_id='56f47451d67240cca46d3d0ff98bed76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc5b94e-90bb-45e4-ba4f-e5294fadb4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc5b94e-90bb-45e4-ba4f-e5294fadb4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e174e4da-f179-42d0-8f72-d79b1ff31dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e174e4da-f179-42d0-8f72-d79b1ff31dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6d7f06-353b-49f9-b416-68a227eaa288', 'volume_name': 'volume-6b6d7f06-353b-49f9-b416-68a227eaa288', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966985b1-22c0-4472-a00a-7925c707d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (966985b1-22c0-4472-a00a-7925c707d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5e900-1ae1-4fc2-869b-dcee4163e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Volume 6b6d7f06-353b-49f9-b416-68a227eaa288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6d7f06-353b-49f9-b416-68a227eaa288', 'volume_size': 1} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868641554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6d7f06-353b-49f9-b416-68a227eaa288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759970655b004948bda723f831dc30da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:28:56Z,use_quota=True,user_id='56f47451d67240cca46d3d0ff98bed76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Creating volume 6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:28:56 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:56 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 1073741824 Sep 01 00:28:56 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:56 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 1073741824" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:56 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:28:56 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:57 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.246s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.433s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating offline snapshot 67c1150a-1674-473d-9168-3f3246ca3718 of volume b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5e900-1ae1-4fc2-869b-dcee4163e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6d7f06-353b-49f9-b416-68a227eaa288', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64051d86-dd66-41dc-a032-6fa50583df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8894126-0fbc-48e5-90d8-9102cca6b0ca]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:57 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Volume volume-6b6d7f06-353b-49f9-b416-68a227eaa288 (6b6d7f06-353b-49f9-b416-68a227eaa288): created successfully Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64051d86-dd66-41dc-a032-6fa50583df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Flow 'volume_create_manager' (d0e4baa7-63ce-4f84-ad49-0e30e242b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:28:57 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-724826e0-8d33-4bca-8357-763acbaae6fb tempest-VolumeDependencyTests-320966616 None] Created volume successfully. Sep 01 00:28:57 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 Sep 01 00:28:57 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:28:57 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74" returned: 0 in 0.389s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:57 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 1G Sep 01 00:28:57 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:57 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 1G" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b799ade4-a35d-418c-8aff-2c43065c8f74 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:57 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b799ade4-a35d-418c-8aff-2c43065c8f74 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 Sep 01 00:28:57 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:58 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b799ade4-a35d-418c-8aff-2c43065c8f74 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:58 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 is being set with open permissions: ugo+rw Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:58 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 Sep 01 00:28:58 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:58 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718" returned: 0 in 0.249s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:58 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info Sep 01 00:28:58 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:58 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info" returned: 0 in 0.242s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:58 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info is being set with open permissions: ugo+rw Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:58 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info Sep 01 00:28:58 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:58 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.info" returned: 0 in 0.246s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.470s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Creating offline snapshot dfa99b6f-a471-45f1-bd85-ed23d0aa0624 of volume 6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52384ee-864e-4338-85c9-ef9206a0f0c9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:28:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-49bdfcee-c738-41b9-ad01-2071d9ee80c4 tempest-VolumesSnapshotTestJSON-1133226852 None] Create snapshot completed successfully Sep 01 00:28:59 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:28:59 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:59 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:59 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 1G Sep 01 00:28:59 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:59 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 1G" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6d7f06-353b-49f9-b416-68a227eaa288 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:28:59 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6d7f06-353b-49f9-b416-68a227eaa288 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:28:59 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-67c1150a-1674-473d-9168-3f3246ca3718-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-67c1150a-1674-473d-9168-3f3246ca3718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-67c1150a-1674-473d-9168-3f3246ca3718" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:28:59 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6d7f06-353b-49f9-b416-68a227eaa288 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:28:59 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 is being set with open permissions: ugo+rw Sep 01 00:28:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-67c1150a-1674-473d-9168-3f3246ca3718" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleting offline snapshot 67c1150a-1674-473d-9168-3f3246ca3718 of volume b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:29:00 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:29:00 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] snapshot_file for this snap is: volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b989e7-fc83-4ea1-8273-6169b113f20b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 Sep 01 00:29:00 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:00 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info Sep 01 00:29:00 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:00 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718" returned: 0 in 0.401s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b799ade4-a35d-418c-8aff-2c43065c8f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda9a22c-c7ee-4efa-99d4-525f5aa9f960]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info" returned: 0 in 0.273s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:00 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info is being set with open permissions: ugo+rw Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info Sep 01 00:29:00 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:00 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 Sep 01 00:29:00 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:00 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.info" returned: 0 in 0.277s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:00 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d12680de-85ab-4061-871d-02c13feee346 tempest-VolumeDependencyTests-320966616 None] Create snapshot completed successfully Sep 01 00:29:00 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74" returned: 0 in 0.453s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:00 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 Sep 01 00:29:00 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:01 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:01 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718 Sep 01 00:29:01 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:01 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74.67c1150a-1674-473d-9168-3f3246ca3718" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-67c1150a-1674-473d-9168-3f3246ca3718" released by "_delete_snapshot" :: held 1.623s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" released by "delete_snapshot" :: held 1.656s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['993ebf6f-14b7-431a-8fb7-6cf25fe41335', '33f6cf98-8573-4e7d-9502-720f68bd6d25', '8736ccbe-e389-4cec-be80-b740518d938c', 'd96857a6-f65e-4e51-a6e8-c5d4ca87d2c4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Delete snapshot completed successfully. Sep 01 00:29:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a0c4c8e-e606-4117-ad55-d5be6c296980 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-67c1150a-1674-473d-9168-3f3246ca3718-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Flow 'volume_create_manager' (223aef48-dc9e-48c4-a0d1-5a88a5a412ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceecfebc-0632-4bda-8319-e743b12c8319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceecfebc-0632-4bda-8319-e743b12c8319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1203145683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a1c175-d876-4e0a-b88e-49d52da6938c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759970655b004948bda723f831dc30da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dfa99b6f-a471-45f1-bd85-ed23d0aa0624,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:02Z,use_quota=True,user_id='56f47451d67240cca46d3d0ff98bed76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22d52ea-74f2-4dc4-a0d5-42dfda20a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22d52ea-74f2-4dc4-a0d5-42dfda20a042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4076dc-f85c-41e5-b560-88b0d520c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4076dc-f85c-41e5-b560-88b0d520c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05a1c175-d876-4e0a-b88e-49d52da6938c', 'volume_name': 'volume-05a1c175-d876-4e0a-b88e-49d52da6938c', 'volume_size': 1, 'snapshot_id': 'dfa99b6f-a471-45f1-bd85-ed23d0aa0624'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571e7a9b-c09d-4d3a-9594-039600c394b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571e7a9b-c09d-4d3a-9594-039600c394b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4134a6bf-207f-41cb-918a-3ca7f477f4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Volume 05a1c175-d876-4e0a-b88e-49d52da6938c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05a1c175-d876-4e0a-b88e-49d52da6938c', 'volume_size': 1, 'snapshot_id': 'dfa99b6f-a471-45f1-bd85-ed23d0aa0624'} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-05a1c175-d876-4e0a-b88e-49d52da6938c" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-05a1c175-d876-4e0a-b88e-49d52da6938c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Creating volume 05a1c175-d876-4e0a-b88e-49d52da6938c from snapshot dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] snapshot: dfa99b6f-a471-45f1-bd85-ed23d0aa0624, volume: 05a1c175-d876-4e0a-b88e-49d52da6938c, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98a262-c45f-4176-8a8d-3d0dcde39be5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:02 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:29:02 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (e908931d-15a3-4eff-b987-e97f9a092be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4450e1-18ed-4ead-8a86-b9bcb7726f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4450e1-18ed-4ead-8a86-b9bcb7726f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111194761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcc1042-1218-4b3a-9de8-32c85851fcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:03Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e6f775-d8f9-48bb-9337-a7368ff6f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e6f775-d8f9-48bb-9337-a7368ff6f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a53bff4-e499-464e-b451-3e0a4894d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a53bff4-e499-464e-b451-3e0a4894d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcc1042-1218-4b3a-9de8-32c85851fcbd', 'volume_name': 'volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76c6242-61c6-462c-b1c7-d301cfd5b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76c6242-61c6-462c-b1c7-d301cfd5b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25feaac-073d-46de-89e5-baeeb1be1622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:02 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume 6dcc1042-1218-4b3a-9de8-32c85851fcbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd', 'volume_size': 1} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:02 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b6d7f06-353b-49f9-b416-68a227eaa288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[287adf38-9dba-4f95-9109-7a29587a735d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:03 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:29:03 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:03 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:29:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:29:03 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:29:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:03 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c Sep 01 00:29:03 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:07 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c" returned: 0 in 4.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:29:07 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Converted 1024.00 MB image at 239.70 MB/s Sep 01 00:29:07 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c is being set with open permissions: ugo+rw Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:07 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c Sep 01 00:29:07 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:07 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c" returned: 0 in 0.245s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" released by "_copy_volume_from_snapshot" :: held 5.315s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-05a1c175-d876-4e0a-b88e-49d52da6938c" released by "_create_volume_from_snapshot" :: held 5.391s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.413s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.037s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111194761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcc1042-1218-4b3a-9de8-32c85851fcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:03Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating volume 6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:29:07 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:07 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd 1073741824 Sep 01 00:29:07 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4134a6bf-207f-41cb-918a-3ca7f477f4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a1c175-d876-4e0a-b88e-49d52da6938c', 'volume_size': 1, 'snapshot_id': 'dfa99b6f-a471-45f1-bd85-ed23d0aa0624'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2685408-ed30-450a-a37d-2e8a1c06cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Volume volume-05a1c175-d876-4e0a-b88e-49d52da6938c (05a1c175-d876-4e0a-b88e-49d52da6938c): created successfully Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2685408-ed30-450a-a37d-2e8a1c06cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Flow 'volume_create_manager' (223aef48-dc9e-48c4-a0d1-5a88a5a412ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e7bcecf9-507c-4de4-92b8-9fd352b07676 tempest-VolumeDependencyTests-320966616 None] Created volume successfully. Sep 01 00:29:08 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd 1073741824" returned: 0 in 0.533s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:08 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:08 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:08 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25feaac-073d-46de-89e5-baeeb1be1622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2fa6bf-2246-4a0a-b62f-477b5f59f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:08 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd (6dcc1042-1218-4b3a-9de8-32c85851fcbd): created successfully Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2fa6bf-2246-4a0a-b62f-477b5f59f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (e908931d-15a3-4eff-b987-e97f9a092be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:08 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-000cdf94-9dcb-481c-b645-da603dc564d8 tempest-VolumesSnapshotTestJSON-1133226852 None] Created volume successfully. Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Deleting offline snapshot dfa99b6f-a471-45f1-bd85-ed23d0aa0624 of volume 6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] snapshot_file for this snap is: volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7bf52-8a89-4521-9f90-d980b35b0dd0]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:09 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:29:09 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:09 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b6d7f06-353b-49f9-b416-68a227eaa288(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995b27f-68d0-48ee-ac12-96b21e779419]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Creating offline snapshot eb333604-1e99-4231-98b6-5e6f7145327d of volume 6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:29:09 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:29:09 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7cd713-03f0-497d-8648-e2659030f482]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:09 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:09 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:10 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.649s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:10 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d 1G Sep 01 00:29:10 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:29:10 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-e8ea17e6-f5c1-451e-a35d-1dc79abf1e96 req-883d0fcd-a9bb-4f69-bdf3-9f900ac9d329 tempest-TestMinimumBasicScenario-1142719744 None] Terminate volume connection completed successfully. Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-e8ea17e6-f5c1-451e-a35d-1dc79abf1e96 req-883d0fcd-a9bb-4f69-bdf3-9f900ac9d329 tempest-TestMinimumBasicScenario-1142719744 None] Deleting attachment e7c9c87c-a996-422b-a514-d0140ddfe07e. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:29:10 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.377s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:10 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d 1G" returned: 0 in 0.414s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:10 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624 Sep 01 00:29:10 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:10 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288.dfa99b6f-a471-45f1-bd85-ed23d0aa0624" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-dfa99b6f-a471-45f1-bd85-ed23d0aa0624" released by "_delete_snapshot" :: held 1.851s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" released by "delete_snapshot" :: held 1.874s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:10 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.355s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:10 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d is being set with open permissions: ugo+rw Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:10 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:10 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Created reservations ['701196f5-9d46-461b-a655-d2ba415b641d', 'a0b8463c-c8ea-4a0e-a138-9f73a741f83a', 'df2e6731-799d-4c34-b8d7-badd48baaefe', '2a23b382-06cd-4820-8b58-a44a6e1b1b72'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Delete snapshot completed successfully. Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1e3d1865-4811-4d9b-a82f-79a68cd95c19 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-dfa99b6f-a471-45f1-bd85-ed23d0aa0624-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "cinder-3be6ba01-773e-46dd-8551-894f6f5ac577-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "cinder-3be6ba01-773e-46dd-8551-894f6f5ac577-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "cinder-quobyte-3be6ba01-773e-46dd-8551-894f6f5ac577" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "cinder-quobyte-3be6ba01-773e-46dd-8551-894f6f5ac577" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dcf63e-1ba4-4df1-96aa-c015469e7894]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:11 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:11 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info Sep 01 00:29:11 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:11 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 Sep 01 00:29:11 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:11 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info" returned: 0 in 0.264s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:11 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info is being set with open permissions: ugo+rw Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:11 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info Sep 01 00:29:11 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:11 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:11 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577 Sep 01 00:29:11 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:11 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.info" returned: 0 in 0.245s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c1c9199-1bad-4f53-ab9c-58ba2fe6e40e tempest-VolumesSnapshotTestJSON-1133226852 None] Create snapshot completed successfully Sep 01 00:29:11 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3be6ba01-773e-46dd-8551-894f6f5ac577" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "cinder-quobyte-3be6ba01-773e-46dd-8551-894f6f5ac577" released by "delete_volume" :: held 0.675s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Created reservations ['49de3093-3a2f-4d25-8603-da8551540079', '8d6b7632-712b-473e-bca0-0f80804058ea', 'e1033f81-8c71-4b81-b590-f2510976647c', '1995d49f-fa3e-4b04-a8bc-b54c66294492'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:11 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:11 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-6b6d7f06-353b-49f9-b416-68a227eaa288-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-6b6d7f06-353b-49f9-b416-68a227eaa288-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:12 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:12 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Deleted volume successfully. Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff05674-f6d0-495f-b18c-b9e8ea862bf2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-094b499f-31a9-4815-ba28-33fa2f389ad2 tempest-TestMinimumBasicScenario-1142719744 None] Lock "cinder-3be6ba01-773e-46dd-8551-894f6f5ac577-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:12 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:29:12 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:12 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.485s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:12 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288 Sep 01 00:29:12 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:12 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6b6d7f06-353b-49f9-b416-68a227eaa288" returned: 0 in 0.392s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-6b6d7f06-353b-49f9-b416-68a227eaa288" released by "delete_volume" :: held 0.951s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Created reservations ['844f076a-ae24-435d-9eae-b34a0d920cc2', '8366bd1a-e67c-4b93-84f2-fc6934682756', '4bd4ab6e-98f1-4df4-9bed-2e7f85e17185', '99dda716-596e-4dfb-8439-7e754f545de3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:13 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:13 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:29:13 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Deleted volume successfully. Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (7cc042cb-fde0-4109-9a82-665ae2f63910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5005000b-a2f4-42d1-b43a-fba2575ad1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ecf4e744-b4e6-4ea1-b9a7-92421919c980 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-6b6d7f06-353b-49f9-b416-68a227eaa288-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5005000b-a2f4-42d1-b43a-fba2575ad1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1514099613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857581cb-3c72-4b8a-94ad-10bf623f5960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=eb333604-1e99-4231-98b6-5e6f7145327d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:13Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:13 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e810cfd3-9115-4bfa-aca5-2eb8bc437554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:13 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e810cfd3-9115-4bfa-aca5-2eb8bc437554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bd52b3-7d8b-4bba-973f-c8839a93434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bd52b3-7d8b-4bba-973f-c8839a93434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '857581cb-3c72-4b8a-94ad-10bf623f5960', 'volume_name': 'volume-857581cb-3c72-4b8a-94ad-10bf623f5960', 'volume_size': 2, 'snapshot_id': 'eb333604-1e99-4231-98b6-5e6f7145327d'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859a0f5-d92f-4c88-8462-3746d35399e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5859a0f5-d92f-4c88-8462-3746d35399e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71963005-3278-4464-8f7f-37325ff6d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:13 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Volume 857581cb-3c72-4b8a-94ad-10bf623f5960: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-857581cb-3c72-4b8a-94ad-10bf623f5960', 'volume_size': 2, 'snapshot_id': 'eb333604-1e99-4231-98b6-5e6f7145327d'} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d-857581cb-3c72-4b8a-94ad-10bf623f5960" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d-857581cb-3c72-4b8a-94ad-10bf623f5960" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Creating volume 857581cb-3c72-4b8a-94ad-10bf623f5960 from snapshot eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] snapshot: eb333604-1e99-4231-98b6-5e6f7145327d, volume: 857581cb-3c72-4b8a-94ad-10bf623f5960, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e59d3ba-f45d-43c1-ba4a-60cfecc2796d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:13 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.385s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:29:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:29:14 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:14 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-05a1c175-d876-4e0a-b88e-49d52da6938c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-05a1c175-d876-4e0a-b88e-49d52da6938c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:14 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.497s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d35697-f12f-4d1e-b8af-1ce1c5dd7dfb]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f190f7-4f28-4b29-8a5c-d657e115cf58]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:14 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:14 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:14 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c Sep 01 00:29:14 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:14 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.395s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:14 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 Sep 01 00:29:14 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:14 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c" returned: 0 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:14 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c Sep 01 00:29:14 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:15 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-05a1c175-d876-4e0a-b88e-49d52da6938c" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-quobyte-05a1c175-d876-4e0a-b88e-49d52da6938c" released by "delete_volume" :: held 0.692s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Created reservations ['a51b131b-1d57-417f-a973-e34b74d7b91e', 'a70056a4-a736-4caa-a7cc-a98b857c0038', 'c9a95d39-7f33-4592-8891-ad201f2a00d4', '85925077-bf65-42c6-b5f9-4f4acf3f2c63'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:15 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:15 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:15 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.559s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:15 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Deleted volume successfully. Sep 01 00:29:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-329d9c7c-2897-4812-be78-e8d40ba40be4 tempest-VolumeDependencyTests-320966616 None] Lock "cinder-05a1c175-d876-4e0a-b88e-49d52da6938c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:21 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960" returned: 0 in 6.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:29:21 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Converted 1024.00 MB image at 160.07 MB/s Sep 01 00:29:21 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 is being set with open permissions: ugo+rw Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:21 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 Sep 01 00:29:21 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:21 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960" returned: 0 in 0.289s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" released by "_copy_volume_from_snapshot" :: held 7.722s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d-857581cb-3c72-4b8a-94ad-10bf623f5960" released by "_create_volume_from_snapshot" :: held 7.793s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.821s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71963005-3278-4464-8f7f-37325ff6d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857581cb-3c72-4b8a-94ad-10bf623f5960', 'volume_size': 2, 'snapshot_id': 'eb333604-1e99-4231-98b6-5e6f7145327d'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b8af8-360d-4010-b664-315a7d3a5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Volume volume-857581cb-3c72-4b8a-94ad-10bf623f5960 (857581cb-3c72-4b8a-94ad-10bf623f5960): created successfully Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b8af8-360d-4010-b664-315a7d3a5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (7cc042cb-fde0-4109-9a82-665ae2f63910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c5d842a-8722-4fb3-a316-7938340fcffc tempest-VolumesSnapshotTestJSON-1133226852 None] Created volume successfully. Sep 01 00:29:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-ac62cc79-ed31-4d6e-bc84-f386b2eafbd6 tempest-TestShelveInstance-1700089868 None] Terminate volume connection completed successfully. Sep 01 00:29:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-ac62cc79-ed31-4d6e-bc84-f386b2eafbd6 tempest-TestShelveInstance-1700089868 None] Deleting attachment 3e71c7c2-d92c-4192-b782-af93739fc8fe. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Acquiring lock "cinder-8016160a-238d-4616-bbbe-ccd45e68c9e9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "cinder-8016160a-238d-4616-bbbe-ccd45e68c9e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Acquiring lock "cinder-quobyte-8016160a-238d-4616-bbbe-ccd45e68c9e9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "cinder-quobyte-8016160a-238d-4616-bbbe-ccd45e68c9e9" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec5071-b3c4-4921-ba00-a5389949190e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:22 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 Sep 01 00:29:22 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-857581cb-3c72-4b8a-94ad-10bf623f5960-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-857581cb-3c72-4b8a-94ad-10bf623f5960-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" acquired by "delete_volume" :: waited 0.059s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:22 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9" returned: 0 in 0.725s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5b403-0b8d-4ca5-b2d1-3e9206ebf45b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:22 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9 Sep 01 00:29:22 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:23 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 Sep 01 00:29:23 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:23 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8016160a-238d-4616-bbbe-ccd45e68c9e9" returned: 0 in 0.337s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "cinder-quobyte-8016160a-238d-4616-bbbe-ccd45e68c9e9" released by "delete_volume" :: held 1.125s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.quota [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Created reservations ['a68215d0-7af6-4d7b-bb07-6052dc6dfae6', '3d3bd7c5-1978-432d-a94d-25e9b85e072a', 'ee677a94-f8a8-46c1-9a34-380f26039462', 'd1539a32-23c9-4dd7-a622-baac96224e5d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:23 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960" returned: 0 in 0.442s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:23 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960 Sep 01 00:29:23 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:23 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:23 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:23 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-857581cb-3c72-4b8a-94ad-10bf623f5960" returned: 0 in 0.313s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-857581cb-3c72-4b8a-94ad-10bf623f5960" released by "delete_volume" :: held 0.877s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:23 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['e799f9e5-0b11-466b-af1b-7d4433109702', '122c9258-ab83-4a58-8ddb-dead5f0325d2', '9b256710-cf04-4799-8507-79c23d7920ee', '08b2fa49-39e6-4769-b797-7535f504a3d7'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:24 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.525s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.manager [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:24 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:24 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Deleted volume successfully. Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [req-44605bbe-48a5-43be-96d5-8a97bcefe2c5 req-75e698c1-fa3d-4699-860b-0430cf98e236 tempest-TestShelveInstance-1700089868 None] Lock "cinder-8016160a-238d-4616-bbbe-ccd45e68c9e9-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:24 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleted volume successfully. Sep 01 00:29:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0d6965b4-9776-4627-934b-d7f8c5692c12 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-857581cb-3c72-4b8a-94ad-10bf623f5960-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-eb333604-1e99-4231-98b6-5e6f7145327d-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-eb333604-1e99-4231-98b6-5e6f7145327d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleting offline snapshot eb333604-1e99-4231-98b6-5e6f7145327d of volume 6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] snapshot_file for this snap is: volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa171efe-1c45-4d5d-948d-70e31b6c6d04]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:25 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:25 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:25 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.480s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e360b3b-72fc-407a-991c-0f5bed942c97]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:25 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:25 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:26 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.772s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:26 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:26 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:26 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:27 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d Sep 01 00:29:27 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:27 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd.eb333604-1e99-4231-98b6-5e6f7145327d" returned: 0 in 0.277s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-eb333604-1e99-4231-98b6-5e6f7145327d" released by "_delete_snapshot" :: held 2.130s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" released by "delete_snapshot" :: held 2.172s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['eca988c5-601d-4211-8f6d-569263ca781f', '6ec3dce8-7375-4523-8b8e-5af94cf63e1e', '56ca8288-bd72-4a65-88b9-14a52ca80a54', 'd069a1fe-d066-476c-9440-40ed0a43e5a3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Delete snapshot completed successfully. Sep 01 00:29:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-39e1b598-8c0c-4e32-bc87-729291d8ef75 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-eb333604-1e99-4231-98b6-5e6f7145327d-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-6dcc1042-1218-4b3a-9de8-32c85851fcbd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-6dcc1042-1218-4b3a-9de8-32c85851fcbd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6917fecf-83bf-49d1-88ec-c18dd2968cfe]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:28 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:28 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:29 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.420s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:29 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd Sep 01 00:29:29 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:29 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6dcc1042-1218-4b3a-9de8-32c85851fcbd" returned: 0 in 0.282s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-6dcc1042-1218-4b3a-9de8-32c85851fcbd" released by "delete_volume" :: held 0.840s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['76d0be61-dbee-4419-b222-5576d3b6e87a', 'e27a2858-8deb-4598-b56b-3c5df0b314b4', '9bccdffe-1ce7-4906-b501-64a218f0e46b', 'd67a890a-a304-431f-b19e-f711836a4b5a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:29 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:29 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:30 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.385s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Deleted volume successfully. Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5bf82e0c-0173-4baf-b6bd-723c6964169e tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-6dcc1042-1218-4b3a-9de8-32c85851fcbd-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (70b28d8b-0372-445d-b601-fa629e993a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdc4d04-bd5e-47ea-ad5f-7695d645f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdc4d04-bd5e-47ea-ad5f-7695d645f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903755240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645d42c5-16fe-41f9-b4e2-9ad45d241a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:30Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba0145a-5541-42a2-a987-40e8f89bf60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba0145a-5541-42a2-a987-40e8f89bf60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db6861a-e883-479e-94a1-988f83b935ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db6861a-e883-479e-94a1-988f83b935ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645d42c5-16fe-41f9-b4e2-9ad45d241a2e', 'volume_name': 'volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f7107-274c-42e5-9cae-bb5e315adec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f7107-274c-42e5-9cae-bb5e315adec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c159d0d-a5dc-4148-9b43-ff255c3cbef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume 645d42c5-16fe-41f9-b4e2-9ad45d241a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e', 'volume_size': 1} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903755240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645d42c5-16fe-41f9-b4e2-9ad45d241a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:30Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating volume 645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:29:30 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:29:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:30 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e 1073741824 Sep 01 00:29:30 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:31 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e 1073741824" returned: 0 in 0.623s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:31 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:31 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:31 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c159d0d-a5dc-4148-9b43-ff255c3cbef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8094e6-5039-4b43-b81f-29257250112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e (645d42c5-16fe-41f9-b4e2-9ad45d241a2e): created successfully Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8094e6-5039-4b43-b81f-29257250112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (70b28d8b-0372-445d-b601-fa629e993a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f83cd907-f9a3-439c-9e53-799cdb4139f1 tempest-VolumesSnapshotTestJSON-1133226852 None] Created volume successfully. Sep 01 00:29:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating offline snapshot da9badf1-fff7-459f-acab-9f1df687c92d of volume 645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:29:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f3a8b-6c6a-49e2-b084-2a07871fe575]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:33 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:33 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:33 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.521s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:33 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d 1G Sep 01 00:29:33 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:34 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d 1G" returned: 0 in 0.550s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:34 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:34 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:34 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.456s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:34 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d is being set with open permissions: ugo+rw Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:34 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:34 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:34 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:34 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info Sep 01 00:29:34 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:35 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:35 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info is being set with open permissions: ugo+rw Sep 01 00:29:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:35 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info Sep 01 00:29:35 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:35 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.info" returned: 0 in 0.428s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4f4765cd-7cdc-42dd-b82c-4d082b5e7124 tempest-VolumesSnapshotTestJSON-1133226852 None] Create snapshot completed successfully Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (6b073fee-fedf-448c-bbae-1c51b198197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec47045a-cfc7-4a7a-a801-5e54dce8e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec47045a-cfc7-4a7a-a801-5e54dce8e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2030502609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00255da2-e9a0-40cc-a2b8-6ea00d3a1806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4266cd08787e478f93c61c2a20499f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da9badf1-fff7-459f-acab-9f1df687c92d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:29:37Z,use_quota=True,user_id='1a670492e10f4a5a9f9f579c4c8d3587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6574085e-ce6d-45e4-9230-2c52c89f74b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6574085e-ce6d-45e4-9230-2c52c89f74b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d958f7-9d8b-4de8-adad-3cfdb4f3d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d958f7-9d8b-4de8-adad-3cfdb4f3d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00255da2-e9a0-40cc-a2b8-6ea00d3a1806', 'volume_name': 'volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806', 'volume_size': 1, 'snapshot_id': 'da9badf1-fff7-459f-acab-9f1df687c92d'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591c6aa-d77f-4441-943d-ad56bd92e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591c6aa-d77f-4441-943d-ad56bd92e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b163155-3e0a-4ff2-a27c-7af53956bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume 00255da2-e9a0-40cc-a2b8-6ea00d3a1806: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806', 'volume_size': 1, 'snapshot_id': 'da9badf1-fff7-459f-acab-9f1df687c92d'} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating volume 00255da2-e9a0-40cc-a2b8-6ea00d3a1806 from snapshot da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] snapshot: da9badf1-fff7-459f-acab-9f1df687c92d, volume: 00255da2-e9a0-40cc-a2b8-6ea00d3a1806, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d066ed2-2855-4dc6-9c31-103dd8499207]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:37 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:37 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:37 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.489s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a27d9b-7af1-401c-8911-4d0a8abcd62e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:37 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:37 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:38 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.451s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:29:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:29:38 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:29:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:38 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 Sep 01 00:29:38 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:43 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" returned: 0 in 5.582s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:43 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:29:43 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Converted 1024.00 MB image at 183.37 MB/s Sep 01 00:29:43 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 is being set with open permissions: ugo+rw Sep 01 00:29:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:43 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 Sep 01 00:29:43 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:43 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" returned: 0 in 0.310s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" released by "_copy_volume_from_snapshot" :: held 6.938s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" released by "_create_volume_from_snapshot" :: held 7.024s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.039s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b163155-3e0a-4ff2-a27c-7af53956bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806', 'volume_size': 1, 'snapshot_id': 'da9badf1-fff7-459f-acab-9f1df687c92d'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664b8dd6-107b-4d3a-b2f8-2709b8903211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:29:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Volume volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 (00255da2-e9a0-40cc-a2b8-6ea00d3a1806): created successfully Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664b8dd6-107b-4d3a-b2f8-2709b8903211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Flow 'volume_create_manager' (6b073fee-fedf-448c-bbae-1c51b198197c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:29:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-508e887f-6475-4a36-bbe3-e86ac9643cd9 tempest-VolumesSnapshotTestJSON-1133226852 None] Created volume successfully. Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-00255da2-e9a0-40cc-a2b8-6ea00d3a1806-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-00255da2-e9a0-40cc-a2b8-6ea00d3a1806-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed801b75-a93b-4c4a-9ae0-111c480ca971]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:44 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 Sep 01 00:29:44 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:45 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" returned: 0 in 0.395s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:45 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806 Sep 01 00:29:45 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:45 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-00255da2-e9a0-40cc-a2b8-6ea00d3a1806" released by "delete_volume" :: held 0.752s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['a9076353-7632-44d0-b3d2-30f5de39332b', 'dcbc006b-0f7c-4399-b2f3-97de5ccb8307', '2e3c7657-aeb1-4761-b2e2-11b5b261cb8e', 'bde28d48-d5d9-49cb-8621-df192d7fc23c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:45 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:45 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-da9badf1-fff7-459f-acab-9f1df687c92d-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:46 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleted volume successfully. Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-da9badf1-fff7-459f-acab-9f1df687c92d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=142,cinder:DELETE=10 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-20a5129d-7814-494e-8017-596178503666 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-00255da2-e9a0-40cc-a2b8-6ea00d3a1806-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleting offline snapshot da9badf1-fff7-459f-acab-9f1df687c92d of volume 645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] snapshot_file for this snap is: volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe3d47-4643-4427-a3d0-6fabc72eff52]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:46 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:46 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:46 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b07121-f8a7-4346-8791-2460579688b7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:46 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:46 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:47 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.632s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:47 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:47 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:47 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.421s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:47 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d Sep 01 00:29:47 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:47 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e.da9badf1-fff7-459f-acab-9f1df687c92d" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:47 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=138,cinder:SELECT=127,cinder:DELETE=13,cinder:INSERT=34 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:29:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-da9badf1-fff7-459f-acab-9f1df687c92d" released by "_delete_snapshot" :: held 1.912s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" released by "delete_snapshot" :: held 1.943s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:48 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['a7858151-634e-496a-a90b-512afdd204c8', '3586766c-d2e7-4d03-8e05-e7d00a20f9b3', '633ecd58-b834-4da2-ac9a-d7bdf0b25e11', '4855eb54-a5ee-4448-bea1-a2f567c7d436'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Delete snapshot completed successfully. Sep 01 00:29:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-868a562a-246e-4f5f-872b-979cb3e39b42 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-da9badf1-fff7-459f-acab-9f1df687c92d-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-645d42c5-16fe-41f9-b4e2-9ad45d241a2e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-645d42c5-16fe-41f9-b4e2-9ad45d241a2e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba85fb1-835e-496a-bd37-622705539265]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:49 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:49 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:49 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.442s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:50 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e Sep 01 00:29:50 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:50 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" returned: 0 in 0.320s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-645d42c5-16fe-41f9-b4e2-9ad45d241a2e" released by "delete_volume" :: held 0.834s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['3fe21acb-3504-4c6c-8239-75c931de72e1', '290b24a6-57eb-451e-b908-255ce69dc693', 'a2075002-11d5-4178-aaa7-dce7370f6e07', '88ee29ad-664a-49e9-8210-970ccd56a76d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:50 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:50 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-b799ade4-a35d-418c-8aff-2c43065c8f74-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-b799ade4-a35d-418c-8aff-2c43065c8f74-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:50 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.326s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:29:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleted volume successfully. Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb838a2c-6b08-4c49-9d2d-71799087dad1 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-645d42c5-16fe-41f9-b4e2-9ad45d241a2e-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e80b21-4873-43be-8815-2fd2480b1f1a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:29:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:51 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 Sep 01 00:29:51 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:51 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74" returned: 0 in 0.452s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:51 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74 Sep 01 00:29:51 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:51 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b799ade4-a35d-418c-8aff-2c43065c8f74" returned: 0 in 0.322s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-quobyte-b799ade4-a35d-418c-8aff-2c43065c8f74" released by "delete_volume" :: held 0.857s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Created reservations ['e49c54bf-9685-4b14-b230-dde1ee8b5a3e', 'b237e553-af90-4ad6-b840-ac79ce9ba4fe', '717ac46f-98a6-40b0-8a3a-2a87de3b615b', 'daf97759-9ccb-4299-a708-0fbda7d4569e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:29:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:29:51 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:29:51 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:29:52 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 01 00:29:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.334s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:29:52 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:29:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Deleted volume successfully. Sep 01 00:29:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abaf956f-6a7f-4d2e-b618-69441fa9ef86 tempest-VolumesSnapshotTestJSON-1133226852 None] Lock "cinder-b799ade4-a35d-418c-8aff-2c43065c8f74-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:01 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:30:02 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Flow 'volume_create_manager' (60e0ef61-c14d-401f-8a87-1a20e496845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e4b34a-9422-4cc7-911a-b691a92201d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e4b34a-9422-4cc7-911a-b691a92201d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1903969249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1db167-75de-4e3d-8524-71117673bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba3933b412745a88b8561a2e40f30c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:09Z,use_quota=True,user_id='94bab2bafb18493481d3681ef7a264c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad607a-b82d-40dd-8902-29eb1206b4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad607a-b82d-40dd-8902-29eb1206b4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cae9e8-6045-47ee-8183-e42097e58819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cae9e8-6045-47ee-8183-e42097e58819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1db167-75de-4e3d-8524-71117673bed3', 'volume_name': 'volume-2c1db167-75de-4e3d-8524-71117673bed3', 'volume_size': 2}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f57311c-46ea-42d5-84c6-cb29948d41cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f57311c-46ea-42d5-84c6-cb29948d41cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39487fd4-263d-4c31-8bd5-15506c6f460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Volume 2c1db167-75de-4e3d-8524-71117673bed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1db167-75de-4e3d-8524-71117673bed3', 'volume_size': 2} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1903969249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1db167-75de-4e3d-8524-71117673bed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba3933b412745a88b8561a2e40f30c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:09Z,use_quota=True,user_id='94bab2bafb18493481d3681ef7a264c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Creating volume 2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:09 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 2147483648 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:09 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 2147483648 Sep 01 00:30:09 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:10 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 2147483648" returned: 0 in 0.619s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:10 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 Sep 01 00:30:10 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:10 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39487fd4-263d-4c31-8bd5-15506c6f460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1db167-75de-4e3d-8524-71117673bed3', 'volume_size': 2}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69605279-56c8-4e22-b66d-5e2f62a94b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:10 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Volume volume-2c1db167-75de-4e3d-8524-71117673bed3 (2c1db167-75de-4e3d-8524-71117673bed3): created successfully Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69605279-56c8-4e22-b66d-5e2f62a94b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Flow 'volume_create_manager' (60e0ef61-c14d-401f-8a87-1a20e496845f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d5f26de0-abd1-42a8-a1fa-3465f069565e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Created volume successfully. Sep 01 00:30:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Creating offline snapshot 9c30de5a-97e4-4fd3-9775-40be89afa686 of volume 2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:30:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f0e3b-f193-4c13-a984-23bc077fa341]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:11 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 Sep 01 00:30:11 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:12 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3" returned: 0 in 0.536s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 2G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:12 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 2G Sep 01 00:30:12 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:12 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 2G" returned: 0 in 0.660s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1db167-75de-4e3d-8524-71117673bed3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:12 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1db167-75de-4e3d-8524-71117673bed3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 Sep 01 00:30:12 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:13 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c1db167-75de-4e3d-8524-71117673bed3 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:13 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 is being set with open permissions: ugo+rw Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:13 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 Sep 01 00:30:13 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:13 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686" returned: 0 in 0.299s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:13 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:30:13 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:13 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info Sep 01 00:30:13 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:13 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:30:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:30:14 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info" returned: 0 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:14 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info is being set with open permissions: ugo+rw Sep 01 00:30:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:14 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info Sep 01 00:30:14 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:14 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.info" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-da170a2c-7257-4d56-a962-2aa71382a2a0 tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Create snapshot completed successfully Sep 01 00:30:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "cinder-9c30de5a-97e4-4fd3-9775-40be89afa686-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-9c30de5a-97e4-4fd3-9775-40be89afa686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "cinder-quobyte-9c30de5a-97e4-4fd3-9775-40be89afa686" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-9c30de5a-97e4-4fd3-9775-40be89afa686" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Deleting offline snapshot 9c30de5a-97e4-4fd3-9775-40be89afa686 of volume 2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] snapshot_file for this snap is: volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[63719cc5-3d0d-4ef3-bea0-838bcb883bc7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:15 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 Sep 01 00:30:15 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:15 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686" returned: 0 in 0.706s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c1db167-75de-4e3d-8524-71117673bed3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[70591562-8d05-4fec-b65c-be7cea9c80c9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:16 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 Sep 01 00:30:16 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:16 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3" returned: 0 in 0.525s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:16 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 Sep 01 00:30:16 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:16 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686" returned: 0 in 0.440s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:16 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686 Sep 01 00:30:16 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:17 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3.9c30de5a-97e4-4fd3-9775-40be89afa686" returned: 0 in 0.307s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-9c30de5a-97e4-4fd3-9775-40be89afa686" released by "_delete_snapshot" :: held 2.243s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" released by "delete_snapshot" :: held 2.310s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:17 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Created reservations ['b95176f8-55ce-499b-a41b-68c770c48e6e', '81e125cf-11b9-4b84-b1e0-fbc8f1d6c3de', '79de5adf-020d-4ace-b081-183cfef1aba5', '88db4065-4159-4b4b-8daf-0c210ddffa07'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:30:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Delete snapshot completed successfully. Sep 01 00:30:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2b0627ad-7612-44bd-a3b7-2d1fee01f23e tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-9c30de5a-97e4-4fd3-9775-40be89afa686-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Flow 'volume_create_manager' (c0bf3436-a1c2-4a1c-b2c1-6497b38260aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efcfcb5-af28-4a90-bd84-a9b5c7d57a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efcfcb5-af28-4a90-bd84-a9b5c7d57a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1101629421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e90c0c-02fb-4c0b-8498-fac861ae8fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d1c6f0c6634159ac345e34908d40d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:18Z,use_quota=True,user_id='bd3d92bf9eb34a42bb6884d2c165bb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769d8523-d4c6-46e9-9c28-e269aded94c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769d8523-d4c6-46e9-9c28-e269aded94c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292f3ff2-2c08-4161-be0c-627b43e98a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292f3ff2-2c08-4161-be0c-627b43e98a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e90c0c-02fb-4c0b-8498-fac861ae8fc4', 'volume_name': 'volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ec6a44-789e-4212-8e4f-b1820fdbdbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ec6a44-789e-4212-8e4f-b1820fdbdbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c7771b-cc5e-440e-878e-b5267f5509ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:18 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Volume 92e90c0c-02fb-4c0b-8498-fac861ae8fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4', 'volume_size': 1} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1101629421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e90c0c-02fb-4c0b-8498-fac861ae8fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d1c6f0c6634159ac345e34908d40d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:18Z,use_quota=True,user_id='bd3d92bf9eb34a42bb6884d2c165bb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Creating volume 92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:18 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:18 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 1073741824 Sep 01 00:30:18 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "cinder-2c1db167-75de-4e3d-8524-71117673bed3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-2c1db167-75de-4e3d-8524-71117673bed3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b15e6-9e31-429c-a386-56b61da69228]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:18 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 Sep 01 00:30:18 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:18 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 1073741824" returned: 0 in 0.661s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:19 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:19 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:19 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3" returned: 0 in 0.540s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:19 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3 Sep 01 00:30:19 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:19 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c7771b-cc5e-440e-878e-b5267f5509ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b3ff69-1d88-455e-802c-ffb52f406042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Volume volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 (92e90c0c-02fb-4c0b-8498-fac861ae8fc4): created successfully Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b3ff69-1d88-455e-802c-ffb52f406042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Flow 'volume_create_manager' (c0bf3436-a1c2-4a1c-b2c1-6497b38260aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2ad23173-9b22-4389-a0e4-5d122e240b8a tempest-TestImageHashVerification-361045803 None] Created volume successfully. Sep 01 00:30:19 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c1db167-75de-4e3d-8524-71117673bed3" returned: 0 in 0.445s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-quobyte-2c1db167-75de-4e3d-8524-71117673bed3" released by "delete_volume" :: held 1.073s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Created reservations ['103072fd-749b-4870-ad11-42cd27284a32', '2f2e4b42-c96b-4d71-90ae-e07e2e069695', '3d11aacc-943d-438f-9bdd-4d61cf2a25ca', 'e3f2bba9-bdf2-429c-9511-cdbb53f9a30e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:19 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:30:19 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:20 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.334s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:20 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:30:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Deleted volume successfully. Sep 01 00:30:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c6d7cd29-1a4a-4ba4-9201-99269165655c tempest-VolumesSnapshotNegativeTestJSON-86615337 None] Lock "cinder-2c1db167-75de-4e3d-8524-71117673bed3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df6944-56e5-433f-9515-120ed1bfdfb5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:21 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:21 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:21 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.441s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b793b95a-1059-49a8-8ffe-ce8199558ffd]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:21 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:21 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:22 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.816s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 /opt/stack/data/cinder/conversion/92e90c0c-02fb-4c0b-8498-fac861ae8fc4.temp_image.8a7244f3-049c-4993-83c9-d92d15cb6cd7r8derefw.img {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:22 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 /opt/stack/data/cinder/conversion/92e90c0c-02fb-4c0b-8498-fac861ae8fc4.temp_image.8a7244f3-049c-4993-83c9-d92d15cb6cd7r8derefw.img Sep 01 00:30:22 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (16979a91-ca02-44cc-88a5-4aee50c0139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07aac02-8006-4369-bcee-0b2b36a54827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07aac02-8006-4369-bcee-0b2b36a54827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612900054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29882aa-5187-480f-89bc-2029fe4a9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:27Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818ff84d-ccb2-4733-9f0a-cb5074cc0d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818ff84d-ccb2-4733-9f0a-cb5074cc0d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0da90cc-34ee-479c-9fbf-7348f2a0cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0da90cc-34ee-479c-9fbf-7348f2a0cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29882aa-5187-480f-89bc-2029fe4a9856', 'volume_name': 'volume-f29882aa-5187-480f-89bc-2029fe4a9856', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db47d48-7dfb-4fb2-a0c3-2bf6c2255c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db47d48-7dfb-4fb2-a0c3-2bf6c2255c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f226fed-6447-4230-8383-80b77a1d5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume f29882aa-5187-480f-89bc-2029fe4a9856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29882aa-5187-480f-89bc-2029fe4a9856', 'volume_size': 1} Sep 01 00:30:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:28 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 /opt/stack/data/cinder/conversion/92e90c0c-02fb-4c0b-8498-fac861ae8fc4.temp_image.8a7244f3-049c-4993-83c9-d92d15cb6cd7r8derefw.img" returned: 0 in 5.808s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dda75b-cffb-4123-bb22-2dc8aaaba775]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:28 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:28 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:28 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.526s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/conversion/92e90c0c-02fb-4c0b-8498-fac861ae8fc4.temp_image.8a7244f3-049c-4993-83c9-d92d15cb6cd7r8derefw.img {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:30:28 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Converted 1024.00 MB image at 176.25 MB/s Sep 01 00:30:28 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] 8a7244f3-049c-4993-83c9-d92d15cb6cd7 was raw, no need to convert to raw {{(pid=87803) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 00:30:37 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:30:38 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=25,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Flow 'volume_create_manager' (98ea6561-d11a-4342-be1f-f3d7a647c166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d14507-1ddd-4751-af26-d3911a92fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d14507-1ddd-4751-af26-d3911a92fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1173841752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a995e4-8445-43a9-bb9e-8ca0b859e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11f5d86f67d4ea9a65bf79f5ea90b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:42Z,use_quota=True,user_id='c0ea305349f545528341b48d7fbf9b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b212296-ecab-4b0d-a0de-e7098a9ada37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b212296-ecab-4b0d-a0de-e7098a9ada37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b163f4-260a-4467-99d2-07571bc879b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b163f4-260a-4467-99d2-07571bc879b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a995e4-8445-43a9-bb9e-8ca0b859e3ac', 'volume_name': 'volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0318db7c-5091-4bb6-a686-4e47a4f0baad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0318db7c-5091-4bb6-a686-4e47a4f0baad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dcfddb-e25b-46a3-9630-a2ddd3a78520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Volume a5a995e4-8445-43a9-bb9e-8ca0b859e3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac', 'volume_size': 1} Sep 01 00:30:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.384s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Uploaded volume to glance image-id: 8a7244f3-049c-4993-83c9-d92d15cb6cd7. {{(pid=87803) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.304s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1612900054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29882aa-5187-480f-89bc-2029fe4a9856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:27Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:47 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:47 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 1073741824 Sep 01 00:30:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ca734dd0-759e-4b18-9f93-ce0b6058db5b tempest-TestImageHashVerification-361045803 None] Copy volume to image completed successfully. Sep 01 00:30:47 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:47 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 1073741824" returned: 0 in 0.410s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:48 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 Sep 01 00:30:48 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:48 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856" returned: 0 in 0.239s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.420s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1173841752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a995e4-8445-43a9-bb9e-8ca0b859e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11f5d86f67d4ea9a65bf79f5ea90b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:42Z,use_quota=True,user_id='c0ea305349f545528341b48d7fbf9b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Creating volume a5a995e4-8445-43a9-bb9e-8ca0b859e3ac {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:48 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f226fed-6447-4230-8383-80b77a1d5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29882aa-5187-480f-89bc-2029fe4a9856', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:48 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac 1073741824 Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7946d3d1-77fd-4a3c-bc78-05da4127841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:48 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:48 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-f29882aa-5187-480f-89bc-2029fe4a9856 (f29882aa-5187-480f-89bc-2029fe4a9856): created successfully Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7946d3d1-77fd-4a3c-bc78-05da4127841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (16979a91-ca02-44cc-88a5-4aee50c0139f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:48 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f60c7db5-64b1-4fec-9122-6e72c5412a4d tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:30:48 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac 1073741824" returned: 0 in 0.471s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:48 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac Sep 01 00:30:48 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Acquiring lock "cinder-92e90c0c-02fb-4c0b-8498-fac861ae8fc4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "cinder-92e90c0c-02fb-4c0b-8498-fac861ae8fc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Acquiring lock "cinder-quobyte-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "cinder-quobyte-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc20532f-4344-4bd5-a844-a03bbeae17be]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:49 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.252s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dcfddb-e25b-46a3-9630-a2ddd3a78520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178797d5-4821-4571-bd1c-77ac9a260623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating offline snapshot 611034b1-2b25-4637-9479-416a2ab847e2 of volume f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:30:49 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Volume volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac (a5a995e4-8445-43a9-bb9e-8ca0b859e3ac): created successfully Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178797d5-4821-4571-bd1c-77ac9a260623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Flow 'volume_create_manager' (98ea6561-d11a-4342-be1f-f3d7a647c166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b316a5-9a45-46f6-8d53-0e9c0be060c5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-24cb7abc-86f7-40c6-80bd-6a31723c4fb8 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Created volume successfully. Sep 01 00:30:49 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:49 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:49 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 Sep 01 00:30:49 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:49 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:49 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4 Sep 01 00:30:49 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:49 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856" returned: 0 in 0.353s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:49 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 1G Sep 01 00:30:49 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:49 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "cinder-quobyte-92e90c0c-02fb-4c0b-8498-fac861ae8fc4" released by "delete_volume" :: held 0.669s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Created reservations ['df986a0f-567d-4158-9305-7da91572b493', '9155ea91-8bfd-4992-8659-537ff523be4c', 'c87af3db-2333-4abc-93d2-395c23330e15', 'f1852dd1-8de5-4bfb-99c0-706104e2273e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:49 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:30:49 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:49 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 1G" returned: 0 in 0.454s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29882aa-5187-480f-89bc-2029fe4a9856 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:50 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29882aa-5187-480f-89bc-2029fe4a9856 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 Sep 01 00:30:50 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:50 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:30:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Deleted volume successfully. Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52f71eba-da41-4aae-956b-7e93c64c0fc4 tempest-TestImageHashVerification-361045803 None] Lock "cinder-92e90c0c-02fb-4c0b-8498-fac861ae8fc4-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:30:50 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29882aa-5187-480f-89bc-2029fe4a9856 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:50 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 is being set with open permissions: ugo+rw Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:50 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 Sep 01 00:30:50 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:50 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:50 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info Sep 01 00:30:50 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:50 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info" returned: 0 in 0.344s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:50 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info is being set with open permissions: ugo+rw Sep 01 00:30:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:51 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info Sep 01 00:30:51 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:51 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.info" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-caadab64-e650-4dfe-9a1d-8374a8d5f464 tempest-CreateVolumesFromSnapshotTest-529690490 None] Create snapshot completed successfully Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-2341e6b2-b4d4-424c-93f5-7e6f84f03ba7 req-e55d09a5-b7fe-4102-9b87-c2a81dc65129 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-2341e6b2-b4d4-424c-93f5-7e6f84f03ba7 req-e55d09a5-b7fe-4102-9b87-c2a81dc65129 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-2341e6b2-b4d4-424c-93f5-7e6f84f03ba7 req-e55d09a5-b7fe-4102-9b87-c2a81dc65129 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-2341e6b2-b4d4-424c-93f5-7e6f84f03ba7 req-e55d09a5-b7fe-4102-9b87-c2a81dc65129 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a0466dd-0c16-47a6-a4d4-4c5b0635bc8e', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:30:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-2341e6b2-b4d4-424c-93f5-7e6f84f03ba7 req-e55d09a5-b7fe-4102-9b87-c2a81dc65129 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] attachment_update completed successfully. Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (09aa8be1-b121-42ef-b324-54e199c42d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44fbe8e-a666-461b-adcc-10ba65833b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44fbe8e-a666-461b-adcc-10ba65833b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112232658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df1b80-1bbe-453d-a985-f5324bce724c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:53Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f68e752-5d11-436c-8880-204cb1ee72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f68e752-5d11-436c-8880-204cb1ee72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587880e7-9974-43eb-86b8-d5776f9ca65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587880e7-9974-43eb-86b8-d5776f9ca65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0df1b80-1bbe-453d-a985-f5324bce724c', 'volume_name': 'volume-e0df1b80-1bbe-453d-a985-f5324bce724c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0af085-3d64-4acf-bb92-e7b8d1a30e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0af085-3d64-4acf-bb92-e7b8d1a30e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7adfc-c420-4b58-aa87-2572c1f74bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:52 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume e0df1b80-1bbe-453d-a985-f5324bce724c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0df1b80-1bbe-453d-a985-f5324bce724c', 'volume_size': 1} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112232658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df1b80-1bbe-453d-a985-f5324bce724c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:53Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume e0df1b80-1bbe-453d-a985-f5324bce724c {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:52 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:52 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c 1073741824 Sep 01 00:30:52 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:53 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c 1073741824" returned: 0 in 0.507s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:54 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c Sep 01 00:30:54 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:54 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c" returned: 0 in 0.239s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7adfc-c420-4b58-aa87-2572c1f74bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0df1b80-1bbe-453d-a985-f5324bce724c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4733b80f-8647-42e8-b418-1c2f7c3cb189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (09c3797b-2891-4214-b1da-4e5af6207cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff4a757-62d9-4cca-9eed-60375cc5f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff4a757-62d9-4cca-9eed-60375cc5f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935378340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744e073-6243-40a7-b76d-5db5276bf6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:53Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcda7521-69eb-44ec-b666-cbcb18b0d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcda7521-69eb-44ec-b666-cbcb18b0d3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262b987d-ed18-4afb-869c-8e31fd6ac593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262b987d-ed18-4afb-869c-8e31fd6ac593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd744e073-6243-40a7-b76d-5db5276bf6b3', 'volume_name': 'volume-d744e073-6243-40a7-b76d-5db5276bf6b3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a372a2-7bf0-4c1b-997d-79259fdf9689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a372a2-7bf0-4c1b-997d-79259fdf9689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db44c8b7-45ed-400f-ad31-a2afdf3a07e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume d744e073-6243-40a7-b76d-5db5276bf6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d744e073-6243-40a7-b76d-5db5276bf6b3', 'volume_size': 1} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935378340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d744e073-6243-40a7-b76d-5db5276bf6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:53Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume d744e073-6243-40a7-b76d-5db5276bf6b3 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:30:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:30:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:54 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 1073741824 Sep 01 00:30:54 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:55 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 1073741824" returned: 0 in 0.407s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-e0df1b80-1bbe-453d-a985-f5324bce724c (e0df1b80-1bbe-453d-a985-f5324bce724c): created successfully Sep 01 00:30:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4733b80f-8647-42e8-b418-1c2f7c3cb189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (09aa8be1-b121-42ef-b324-54e199c42d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b14d4b7d-bcbd-4649-a4b6-c2cebd6a7010 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:30:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:30:56 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 Sep 01 00:30:56 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:30:57 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 01 00:30:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3" returned: 0 in 0.242s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:30:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:30:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:30:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db44c8b7-45ed-400f-ad31-a2afdf3a07e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d744e073-6243-40a7-b76d-5db5276bf6b3', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0312afc-3bb6-448c-a811-9e309a994d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:30:58 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-d744e073-6243-40a7-b76d-5db5276bf6b3 (d744e073-6243-40a7-b76d-5db5276bf6b3): created successfully Sep 01 00:30:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0312afc-3bb6-448c-a811-9e309a994d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:30:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (09c3797b-2891-4214-b1da-4e5af6207cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:30:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-df2c8d56-4463-42dd-8eb4-e491d0e55570 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:30:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-c9fdb87c-030b-4519-9739-7b5f107f88c2 req-556616bf-7ade-4553-bedd-b111cb198f73 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Terminate volume connection completed successfully. Sep 01 00:30:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-c9fdb87c-030b-4519-9739-7b5f107f88c2 req-556616bf-7ade-4553-bedd-b111cb198f73 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Deleting attachment 6a0466dd-0c16-47a6-a4d4-4c5b0635bc8e. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (edadca65-0fff-41b0-a78d-2ba54c67d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfbf745-57b5-4b65-9f56-2e0e2fc41591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfbf745-57b5-4b65-9f56-2e0e2fc41591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607282372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e0590c-da57-4028-8d72-b21c22dacc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:58Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144b4366-22d8-40e2-85ea-7c361788dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144b4366-22d8-40e2-85ea-7c361788dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd69f67c-4ab6-47ae-9ef0-61860742dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd69f67c-4ab6-47ae-9ef0-61860742dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e0590c-da57-4028-8d72-b21c22dacc3e', 'volume_name': 'volume-01e0590c-da57-4028-8d72-b21c22dacc3e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fabdf4-c064-4d16-889e-9ed574a3b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74fabdf4-c064-4d16-889e-9ed574a3b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f51128b-2776-4735-b151-04803a96cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume 01e0590c-da57-4028-8d72-b21c22dacc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e0590c-da57-4028-8d72-b21c22dacc3e', 'volume_size': 1} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607282372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e0590c-da57-4028-8d72-b21c22dacc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:30:58Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume 01e0590c-da57-4028-8d72-b21c22dacc3e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:00 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e 1073741824 Sep 01 00:31:00 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:01 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e 1073741824" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:03 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e Sep 01 00:31:03 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:03 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e" returned: 0 in 0.240s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (2941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.945s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "cinder-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "cinder-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f51128b-2776-4735-b151-04803a96cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e0590c-da57-4028-8d72-b21c22dacc3e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5914bbd0-abe8-47d3-9672-2ad418fa52b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "cinder-quobyte-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-01e0590c-da57-4028-8d72-b21c22dacc3e (01e0590c-da57-4028-8d72-b21c22dacc3e): created successfully Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5914bbd0-abe8-47d3-9672-2ad418fa52b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (edadca65-0fff-41b0-a78d-2ba54c67d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:04 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fe9bbc66-f7fa-41c2-ab61-8c5614f86a1d tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "cinder-quobyte-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" acquired by "delete_volume" :: waited 0.071s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1bf45-5e25-44f3-8198-5afc8b4040e7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:04 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (db738e70-6876-4b14-a7b1-41656bf176dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c46f541-7c24-4d53-b437-96f547c69da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c46f541-7c24-4d53-b437-96f547c69da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507991979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d45ba26-4bcb-4199-962b-2214865e188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:05Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac Sep 01 00:31:05 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015ebc87-26be-4d6b-8b50-20b8be1309f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015ebc87-26be-4d6b-8b50-20b8be1309f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cbdf7-878a-4d19-8af6-8cbb07f0c4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083cbdf7-878a-4d19-8af6-8cbb07f0c4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d45ba26-4bcb-4199-962b-2214865e188d', 'volume_name': 'volume-6d45ba26-4bcb-4199-962b-2214865e188d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c9ff3-0178-4653-bbdf-12e525459668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c9ff3-0178-4653-bbdf-12e525459668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70c7415-86d5-4d08-90f8-b503f64339b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume 6d45ba26-4bcb-4199-962b-2214865e188d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d45ba26-4bcb-4199-962b-2214865e188d', 'volume_size': 1} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507991979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d45ba26-4bcb-4199-962b-2214865e188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:05Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume 6d45ba26-4bcb-4199-962b-2214865e188d {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:05 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:05 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d 1073741824 Sep 01 00:31:05 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:05 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (9138040c-13b3-4424-8b90-8d5db1ee7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3ac501-d949-4a28-8dc1-2ec45b7fc78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" returned: 0 in 0.496s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3ac501-d949-4a28-8dc1-2ec45b7fc78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397529724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38136cf4-ba66-4b33-98d4-e9d3a2ace7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:05Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e04a07-04c3-4976-8c7e-63f841a9912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac Sep 01 00:31:05 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e04a07-04c3-4976-8c7e-63f841a9912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32b91a2-c510-40cc-b1c7-68296ec51562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32b91a2-c510-40cc-b1c7-68296ec51562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38136cf4-ba66-4b33-98d4-e9d3a2ace7dd', 'volume_name': 'volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae85f2e8-04c6-4bc2-87c8-d107bdcf28f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae85f2e8-04c6-4bc2-87c8-d107bdcf28f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6bda48-2880-458a-80bb-a043a9f1942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume 38136cf4-ba66-4b33-98d4-e9d3a2ace7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd', 'volume_size': 1} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:05 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:05 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d 1073741824" returned: 0 in 0.608s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "cinder-quobyte-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac" released by "delete_volume" :: held 0.900s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:05 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d Sep 01 00:31:05 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Created reservations ['26fafd43-ca7c-49e7-ad87-95468ce583e7', '0d2680c5-40dc-477c-b13f-61b59fd92d48', 'c577b9dc-2f54-4d25-aa32-36987a466a3a', 'ce4bc7a3-bfb3-4798-b8d4-5da2c5798922'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:05 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:05 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:06 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397529724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38136cf4-ba66-4b33-98d4-e9d3a2ace7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b8e2d3bdb64f5c890c2f254a299d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:05Z,use_quota=True,user_id='f1090ed951d442a29b3e13f04dfc00bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Creating volume 38136cf4-ba66-4b33-98d4-e9d3a2ace7dd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:06 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70c7415-86d5-4d08-90f8-b503f64339b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d45ba26-4bcb-4199-962b-2214865e188d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab2d00-8761-45aa-ad70-9faae81738b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:06 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd 1073741824 Sep 01 00:31:06 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:06 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-6d45ba26-4bcb-4199-962b-2214865e188d (6d45ba26-4bcb-4199-962b-2214865e188d): created successfully Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab2d00-8761-45aa-ad70-9faae81738b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (db738e70-6876-4b14-a7b1-41656bf176dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a549ea0b-4d24-4917-9cbe-21cf0d392d37 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:31:06 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.293s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Deleted volume successfully. Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3cf58c58-0019-4539-b063-1d42e60bc6b3 tempest-TestServerVolumeAttachScenarioOldVersion-360538886 None] Lock "cinder-a5a995e4-8445-43a9-bb9e-8ca0b859e3ac-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:06 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd 1073741824" returned: 0 in 0.606s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:06 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd Sep 01 00:31:06 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:07 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" returned: 0 in 0.353s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6bda48-2880-458a-80bb-a043a9f1942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42680a58-c18f-48b0-b527-29ca819e1894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Volume volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd (38136cf4-ba66-4b33-98d4-e9d3a2ace7dd): created successfully Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42680a58-c18f-48b0-b527-29ca819e1894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Flow 'volume_create_manager' (9138040c-13b3-4424-8b90-8d5db1ee7902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e2100960-5f1c-438d-994c-0dc5d7b5733a tempest-CreateVolumesFromSnapshotTest-529690490 None] Created volume successfully. Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8f540c-ff04-42eb-af58-60b789b1c0ed]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:08 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd Sep 01 00:31:08 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:08 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" returned: 0 in 0.464s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:08 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd Sep 01 00:31:08 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:08 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" returned: 0 in 0.273s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd" released by "delete_volume" :: held 0.798s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['f6fff688-e783-491e-ae09-0678a62b7dc1', 'f6bea143-f0a1-44b0-b65f-97f5b90c53b8', '4ccf6d52-8c6e-453d-8016-0f5eb8ccfb6d', '18f85d70-9c6b-4de8-b3a4-2d2a7b674673'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:08 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:08 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-6d45ba26-4bcb-4199-962b-2214865e188d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-6d45ba26-4bcb-4199-962b-2214865e188d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-6d45ba26-4bcb-4199-962b-2214865e188d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-6d45ba26-4bcb-4199-962b-2214865e188d" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:09 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.338s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99bb021-52cf-4c1c-827b-b58846b5a237]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e69c7a36-f6a2-4b14-bc37-67549c49dbcf tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-38136cf4-ba66-4b33-98d4-e9d3a2ace7dd-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:09 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d Sep 01 00:31:09 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:09 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d" returned: 0 in 0.460s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:09 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d Sep 01 00:31:09 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:10 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6d45ba26-4bcb-4199-962b-2214865e188d" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-6d45ba26-4bcb-4199-962b-2214865e188d" released by "delete_volume" :: held 0.827s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['072255bf-40a3-47b1-ab5a-5d71fa34c75f', '007b9c40-6f5d-404b-b114-352a307cdb1d', '64e53d95-e00a-428d-a2fe-265df3cf6bbd', '63261942-6372-47e7-851c-0b34c10f78c1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:10 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:10 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-01e0590c-da57-4028-8d72-b21c22dacc3e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-01e0590c-da57-4028-8d72-b21c22dacc3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-01e0590c-da57-4028-8d72-b21c22dacc3e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-01e0590c-da57-4028-8d72-b21c22dacc3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:10 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed402b96-3358-47c8-949e-3f9db9f762db]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc4cceab-db30-4d7a-a5aa-0de2ee378e5f tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-6d45ba26-4bcb-4199-962b-2214865e188d-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:10 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e Sep 01 00:31:10 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:11 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e" returned: 0 in 0.497s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:11 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e Sep 01 00:31:11 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:11 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-01e0590c-da57-4028-8d72-b21c22dacc3e" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-01e0590c-da57-4028-8d72-b21c22dacc3e" released by "delete_volume" :: held 0.865s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['f51034a7-b205-43e4-aa4b-aecdc6e86aae', 'b614c05b-1cc2-4359-a009-8d3104ff62d1', '83c979d7-259e-4eef-bc9e-b9f57e8606a8', 'b6770fff-87d4-476f-8f9e-968a2006d1ac'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:11 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:11 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-d744e073-6243-40a7-b76d-5db5276bf6b3-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-d744e073-6243-40a7-b76d-5db5276bf6b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-d744e073-6243-40a7-b76d-5db5276bf6b3" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-d744e073-6243-40a7-b76d-5db5276bf6b3" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[958bb86f-6a38-4511-938e-a1d700367bf5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:11 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 Sep 01 00:31:11 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:11 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-685d8507-5c50-4949-bf52-9c0cd1a49850 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-01e0590c-da57-4028-8d72-b21c22dacc3e-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:12 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3" returned: 0 in 0.430s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:12 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3 Sep 01 00:31:12 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:12 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d744e073-6243-40a7-b76d-5db5276bf6b3" returned: 0 in 0.289s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-d744e073-6243-40a7-b76d-5db5276bf6b3" released by "delete_volume" :: held 0.774s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['ed25cc7a-3e26-410b-b351-4b0b29a7793b', '0e63cdef-0c87-475c-8642-2bf49c3e6896', '45303994-c78a-4b33-be2b-decbb59ab3d9', '5f915017-17f1-4323-85bd-9aa01aad3b53'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:12 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:12 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-e0df1b80-1bbe-453d-a985-f5324bce724c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-e0df1b80-1bbe-453d-a985-f5324bce724c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-e0df1b80-1bbe-453d-a985-f5324bce724c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-e0df1b80-1bbe-453d-a985-f5324bce724c" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf40471-7a08-4d8a-b8bc-d9d83624917a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:13 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.434s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dd783352-8538-44fa-94fe-17edf382a78e tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-d744e073-6243-40a7-b76d-5db5276bf6b3-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:13 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c Sep 01 00:31:13 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:13 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c" returned: 0 in 0.423s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:13 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c Sep 01 00:31:13 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:13 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:13 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:13 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e0df1b80-1bbe-453d-a985-f5324bce724c" returned: 0 in 0.365s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-e0df1b80-1bbe-453d-a985-f5324bce724c" released by "delete_volume" :: held 0.867s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['a847278b-b35f-4673-932f-e62126bcde83', '9d7799c3-30e4-4cde-93a6-4e070af55f27', '99636e25-e7e4-4f10-9cef-cedaab19ccbb', '0d9159cc-9fc9-405d-b215-d16bc756bade'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:14 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.426s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:14 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:14 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-611034b1-2b25-4637-9479-416a2ab847e2-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-611034b1-2b25-4637-9479-416a2ab847e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-611034b1-2b25-4637-9479-416a2ab847e2" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-611034b1-2b25-4637-9479-416a2ab847e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleting offline snapshot 611034b1-2b25-4637-9479-416a2ab847e2 of volume f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] snapshot_file for this snap is: volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c896d628-b470-45ba-9a48-45d5e9379207]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:14 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 Sep 01 00:31:14 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:14 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.329s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8cfac4dc-a2e3-4273-9195-eeb218f12715 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-e0df1b80-1bbe-453d-a985-f5324bce724c-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:14 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2" returned: 0 in 0.443s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29882aa-5187-480f-89bc-2029fe4a9856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ef717-2ca7-4e61-8e20-e29e3bd2683c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:14 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 Sep 01 00:31:14 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:15 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856" returned: 0 in 0.402s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:15 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 Sep 01 00:31:15 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Flow 'volume_create_manager' (9ade985f-fc68-4e56-9cd3-28e7f3ff9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77195da-7de2-4a62-9170-39c212a654ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77195da-7de2-4a62-9170-39c212a654ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275074670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b842eaa7-29ac-4200-8e25-6c154626bd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9e2f6fb23549e19e4f19e1d0e1606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:15Z,use_quota=True,user_id='726f8834409d4780b91b1ba330352188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2becd5a7-0e16-4cd4-9c58-2a9abb23f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2becd5a7-0e16-4cd4-9c58-2a9abb23f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:15 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce33dbf9-a4f7-467f-aa80-0bbc36e0b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce33dbf9-a4f7-467f-aa80-0bbc36e0b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b842eaa7-29ac-4200-8e25-6c154626bd17', 'volume_name': 'volume-b842eaa7-29ac-4200-8e25-6c154626bd17', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eabbed2-7a70-4984-afd9-482257815b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eabbed2-7a70-4984-afd9-482257815b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68cec66-1400-452f-b579-6a7cf020df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:15 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Volume b842eaa7-29ac-4200-8e25-6c154626bd17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b842eaa7-29ac-4200-8e25-6c154626bd17', 'volume_size': 1} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1275074670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b842eaa7-29ac-4200-8e25-6c154626bd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9e2f6fb23549e19e4f19e1d0e1606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:15Z,use_quota=True,user_id='726f8834409d4780b91b1ba330352188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Creating volume b842eaa7-29ac-4200-8e25-6c154626bd17 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:15 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:15 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 1073741824 Sep 01 00:31:15 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:15 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2 Sep 01 00:31:15 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:15 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856.611034b1-2b25-4637-9479-416a2ab847e2" returned: 0 in 0.258s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-611034b1-2b25-4637-9479-416a2ab847e2" released by "_delete_snapshot" :: held 1.646s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" released by "delete_snapshot" :: held 1.677s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['64da0bc2-1aea-4a8b-96fd-f13480340ae2', '3d9b6151-e1e8-4eb8-89a5-c0658dfef615', 'd1bf07d8-efe9-447b-bcc7-6926b8a30ebe', '89aee08e-da3e-4d21-9b0a-ea1d6b9973b8'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Delete snapshot completed successfully. Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b53fd3a-3e4c-4ec6-8f3a-bf83e2b64cc6 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-611034b1-2b25-4637-9479-416a2ab847e2-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:16 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 1073741824" returned: 0 in 0.592s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:16 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 Sep 01 00:31:16 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-f29882aa-5187-480f-89bc-2029fe4a9856-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:16 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17" returned: 0 in 0.263s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-f29882aa-5187-480f-89bc-2029fe4a9856-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68cec66-1400-452f-b579-6a7cf020df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b842eaa7-29ac-4200-8e25-6c154626bd17', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c0814b-2cfe-4c2c-8021-bf5747295fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:16 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Volume volume-b842eaa7-29ac-4200-8e25-6c154626bd17 (b842eaa7-29ac-4200-8e25-6c154626bd17): created successfully Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c0814b-2cfe-4c2c-8021-bf5747295fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Flow 'volume_create_manager' (9ade985f-fc68-4e56-9cd3-28e7f3ff9410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-17ae1400-0a9d-4332-a164-9caaea177000 tempest-ProjectReaderTests-1881265738 None] Created volume successfully. Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[502930f1-84e8-439d-8f3b-8e3c87797561]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:16 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 Sep 01 00:31:16 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:16 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:16 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856 Sep 01 00:31:16 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:17 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f29882aa-5187-480f-89bc-2029fe4a9856" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-quobyte-f29882aa-5187-480f-89bc-2029fe4a9856" released by "delete_volume" :: held 0.730s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Created reservations ['18a03770-01ec-4a6b-b6dd-4e8dd93ecc0a', '3ca0466b-00cd-461b-98a8-d2151cf1b468', '23274448-074a-4a2d-b24b-ed2d69b95403', 'ce733837-991f-4e56-b01f-dc5ddc086c02'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:17 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:17 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:17 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.250s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Deleted volume successfully. Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ed2bea65-d63b-49df-996f-2f0d40863774 tempest-CreateVolumesFromSnapshotTest-529690490 None] Lock "cinder-f29882aa-5187-480f-89bc-2029fe4a9856-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "cinder-b842eaa7-29ac-4200-8e25-6c154626bd17-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-b842eaa7-29ac-4200-8e25-6c154626bd17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "cinder-quobyte-b842eaa7-29ac-4200-8e25-6c154626bd17" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-quobyte-b842eaa7-29ac-4200-8e25-6c154626bd17" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[259905fb-c68a-4edf-95cf-e92e6025d952]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:18 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 Sep 01 00:31:18 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:18 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17" returned: 0 in 0.425s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:18 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17 Sep 01 00:31:18 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:18 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b842eaa7-29ac-4200-8e25-6c154626bd17" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-quobyte-b842eaa7-29ac-4200-8e25-6c154626bd17" released by "delete_volume" :: held 0.768s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Created reservations ['8b53b0d6-d356-44cd-a18a-95d74813f507', '69e51a13-4ac0-4399-be03-fd798a1b6b2c', 'c369428e-29af-4b26-8098-3be5f0358488', '02c40441-a69e-4962-80f5-906b9c3c47a1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:18 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:18 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:19 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.360s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Deleted volume successfully. Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9c501633-358c-4c2b-b064-4fac9efad395 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-b842eaa7-29ac-4200-8e25-6c154626bd17-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Flow 'volume_create_manager' (ec4a2b49-6967-4fc2-8a5b-2a58a4c5127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206ad10-b01d-4b00-a91e-dbd297db3f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206ad10-b01d-4b00-a91e-dbd297db3f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988170653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f757481-de79-4669-8afc-693173c5951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9e2f6fb23549e19e4f19e1d0e1606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:20Z,use_quota=True,user_id='726f8834409d4780b91b1ba330352188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebae566-780b-426b-858e-d2df1389a1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebae566-780b-426b-858e-d2df1389a1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9831b8-155a-4ceb-beb0-997b275d57f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9831b8-155a-4ceb-beb0-997b275d57f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f757481-de79-4669-8afc-693173c5951e', 'volume_name': 'volume-0f757481-de79-4669-8afc-693173c5951e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbacd74-4c62-4c33-ab36-12d80f06b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbacd74-4c62-4c33-ab36-12d80f06b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e36a3b8-68e3-4730-88ac-d58ef9c359a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Volume 0f757481-de79-4669-8afc-693173c5951e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f757481-de79-4669-8afc-693173c5951e', 'volume_size': 1} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988170653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f757481-de79-4669-8afc-693173c5951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9e2f6fb23549e19e4f19e1d0e1606b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:20Z,use_quota=True,user_id='726f8834409d4780b91b1ba330352188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Creating volume 0f757481-de79-4669-8afc-693173c5951e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:19 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:19 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e 1073741824 Sep 01 00:31:19 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:20 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e 1073741824" returned: 0 in 0.535s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:20 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e Sep 01 00:31:20 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:20 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e36a3b8-68e3-4730-88ac-d58ef9c359a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f757481-de79-4669-8afc-693173c5951e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc0413-1a40-4e26-93cb-52f266a99a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:20 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Volume volume-0f757481-de79-4669-8afc-693173c5951e (0f757481-de79-4669-8afc-693173c5951e): created successfully Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc0413-1a40-4e26-93cb-52f266a99a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:20 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Flow 'volume_create_manager' (ec4a2b49-6967-4fc2-8a5b-2a58a4c5127e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-40a0a819-132c-492d-a43c-cdbe7fe2ab10 tempest-ProjectReaderTests-1881265738 None] Created volume successfully. Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (5ee07ebb-b1a0-43a8-b54e-0880198e7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aff9f78-a780-42a0-a904-3d6012982bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aff9f78-a780-42a0-a904-3d6012982bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961300188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85924df-c68c-4d44-bb92-010be34728d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:21Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d211172f-c3f2-4c2d-b61f-af597be7275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d211172f-c3f2-4c2d-b61f-af597be7275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7287fc-67cd-49f3-9e3f-0239a8d03bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7287fc-67cd-49f3-9e3f-0239a8d03bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85924df-c68c-4d44-bb92-010be34728d2', 'volume_name': 'volume-d85924df-c68c-4d44-bb92-010be34728d2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf696130-7af8-48aa-b91c-77dc9ac756c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf696130-7af8-48aa-b91c-77dc9ac756c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ad070-5fd5-4bf7-b1f1-3296c66b295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume d85924df-c68c-4d44-bb92-010be34728d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85924df-c68c-4d44-bb92-010be34728d2', 'volume_size': 1} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961300188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85924df-c68c-4d44-bb92-010be34728d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:21Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume d85924df-c68c-4d44-bb92-010be34728d2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:21 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:21 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 1073741824 Sep 01 00:31:21 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "cinder-0f757481-de79-4669-8afc-693173c5951e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-0f757481-de79-4669-8afc-693173c5951e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "cinder-quobyte-0f757481-de79-4669-8afc-693173c5951e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:21 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 1073741824" returned: 0 in 0.615s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-quobyte-0f757481-de79-4669-8afc-693173c5951e" acquired by "delete_volume" :: waited 0.042s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f53f8b3-86b3-4842-a785-3a396aa8a121]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:21 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 Sep 01 00:31:22 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:22 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e Sep 01 00:31:22 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:22 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2" returned: 0 in 0.315s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ad070-5fd5-4bf7-b1f1-3296c66b295a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85924df-c68c-4d44-bb92-010be34728d2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9487fd-6ae8-4498-8d99-765bac8c459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-d85924df-c68c-4d44-bb92-010be34728d2 (d85924df-c68c-4d44-bb92-010be34728d2): created successfully Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9487fd-6ae8-4498-8d99-765bac8c459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (5ee07ebb-b1a0-43a8-b54e-0880198e7245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f67f6257-4f2a-4580-9e91-7b0383969d9d tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:22 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:22 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e Sep 01 00:31:22 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:22 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-0f757481-de79-4669-8afc-693173c5951e" returned: 0 in 0.265s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-quobyte-0f757481-de79-4669-8afc-693173c5951e" released by "delete_volume" :: held 0.768s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Created reservations ['40c4fb36-708a-41a1-a718-0f0567c47533', 'a3053e84-716c-4500-a63b-6e545183c799', 'ce8c17d3-b04e-4431-9889-717dc171299f', '8eb0739a-c4f4-49e7-8621-1bc16eb4c35d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:22 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:22 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:23 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Deleted volume successfully. Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-054b087a-ef7f-4ae3-aec7-ca65a8b747b7 tempest-ProjectReaderTests-1881265738 None] Lock "cinder-0f757481-de79-4669-8afc-693173c5951e-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (5615eba5-963c-4c77-98c7-4d36cd19af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9ce442-317d-4441-9646-159338768f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9ce442-317d-4441-9646-159338768f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561151824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0043a-8e75-4797-8c1d-eb4c6a5ba493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:24Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88003fc-e439-4a5d-b641-021095e97901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88003fc-e439-4a5d-b641-021095e97901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce138c46-fd25-464e-93bb-083581de78c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce138c46-fd25-464e-93bb-083581de78c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc0043a-8e75-4797-8c1d-eb4c6a5ba493', 'volume_name': 'volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51d96-b1b1-4df9-af6a-8db72e05252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f51d96-b1b1-4df9-af6a-8db72e05252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1c9b5e-a367-4494-a7d1-4b82cdc3a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:23 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume edc0043a-8e75-4797-8c1d-eb4c6a5ba493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493', 'volume_size': 1} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561151824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0043a-8e75-4797-8c1d-eb4c6a5ba493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:24Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume edc0043a-8e75-4797-8c1d-eb4c6a5ba493 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:23 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:23 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 1073741824 Sep 01 00:31:24 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (6ce9e2ae-a2c5-4cc8-96cb-b8755bbd05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c57528c-a23c-4041-ade1-29e7fb055310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c57528c-a23c-4041-ade1-29e7fb055310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775536770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df35e6e-5a83-4a5c-8b11-efd603d4cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:24Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30577e3-6e74-4f6e-a096-92245f7c54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30577e3-6e74-4f6e-a096-92245f7c54a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99250bc3-3093-43d8-81fe-01427ee5a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99250bc3-3093-43d8-81fe-01427ee5a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df35e6e-5a83-4a5c-8b11-efd603d4cefc', 'volume_name': 'volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec536919-ef01-4010-bf52-8c4591f6664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec536919-ef01-4010-bf52-8c4591f6664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed97d1e-d7a0-4aad-92ea-c99bf7bda7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume 4df35e6e-5a83-4a5c-8b11-efd603d4cefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc', 'volume_size': 1} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:24 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 1073741824" returned: 0 in 0.776s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (d4057ee0-02e8-4dd9-8b05-1c9477dd7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d1b809-a5f4-4873-8d23-9f6aece16f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d1b809-a5f4-4873-8d23-9f6aece16f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410963713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409dfe21-4717-42df-8473-b94821121d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:25Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6dea29-bd1d-4b1c-ae7e-1b7e120c9dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6dea29-bd1d-4b1c-ae7e-1b7e120c9dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13592b1-1c4e-4267-bb3d-868949821535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13592b1-1c4e-4267-bb3d-868949821535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409dfe21-4717-42df-8473-b94821121d40', 'volume_name': 'volume-409dfe21-4717-42df-8473-b94821121d40', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9844c-2426-49d7-a244-9fd2f1f059c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9844c-2426-49d7-a244-9fd2f1f059c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9476cb79-b6f3-4352-927c-827bc8025e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume 409dfe21-4717-42df-8473-b94821121d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409dfe21-4717-42df-8473-b94821121d40', 'volume_size': 1} Sep 01 00:31:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:25 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (357b3b29-9084-4a2a-8cbc-c0e25a447f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6247ec02-df76-4612-b131-29a583e04ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" returned: 0 in 0.456s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1775536770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df35e6e-5a83-4a5c-8b11-efd603d4cefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:24Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume 4df35e6e-5a83-4a5c-8b11-efd603d4cefc {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:25 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6247ec02-df76-4612-b131-29a583e04ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592456961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23f61c3-8bac-40eb-a912-7c365f5a48bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:25Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405f3927-48ae-468b-9f0c-6f1e5a6fbc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc 1073741824 Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405f3927-48ae-468b-9f0c-6f1e5a6fbc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fc8de-df6b-4269-a7cb-8979f51317f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fc8de-df6b-4269-a7cb-8979f51317f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23f61c3-8bac-40eb-a912-7c365f5a48bd', 'volume_name': 'volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91332aa2-84fc-4b01-8521-3ba1f12d339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91332aa2-84fc-4b01-8521-3ba1f12d339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b972a72e-0570-4d26-ade2-4d2e9792e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume d23f61c3-8bac-40eb-a912-7c365f5a48bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd', 'volume_size': 1} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1c9b5e-a367-4494-a7d1-4b82cdc3a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d35ebc5-0140-4a4f-8c0c-34af74dd2279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 (edc0043a-8e75-4797-8c1d-eb4c6a5ba493): created successfully Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d35ebc5-0140-4a4f-8c0c-34af74dd2279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (5615eba5-963c-4c77-98c7-4d36cd19af68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d0092aba-78b8-4fe7-87d5-e18d13d3fc95 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (88cf1172-be03-4202-bdc3-e63f1463ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1cdac0-b40c-4cfc-8c84-725e356a2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1cdac0-b40c-4cfc-8c84-725e356a2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218700985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c44b621-cc75-4e21-b2ee-06178b299d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:26Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:25 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fef6afb-6fd6-44e4-8785-67cf54ce636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fef6afb-6fd6-44e4-8785-67cf54ce636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d9eafd-0004-4eba-95f9-b7d79db30799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d9eafd-0004-4eba-95f9-b7d79db30799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c44b621-cc75-4e21-b2ee-06178b299d8a', 'volume_name': 'volume-2c44b621-cc75-4e21-b2ee-06178b299d8a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b36ce9-0b00-4292-a243-642477664bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b36ce9-0b00-4292-a243-642477664bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177a9093-031c-4a3d-be81-cbf6971e8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:26 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume 2c44b621-cc75-4e21-b2ee-06178b299d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c44b621-cc75-4e21-b2ee-06178b299d8a', 'volume_size': 1} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:26 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc 1073741824" returned: 0 in 0.650s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:26 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc Sep 01 00:31:26 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:26 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410963713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409dfe21-4717-42df-8473-b94821121d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:25Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume 409dfe21-4717-42df-8473-b94821121d40 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:26 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed97d1e-d7a0-4aad-92ea-c99bf7bda7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef2c59d-e4e0-499d-af29-2697eff4db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:26 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 1073741824 Sep 01 00:31:26 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:26 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc (4df35e6e-5a83-4a5c-8b11-efd603d4cefc): created successfully Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef2c59d-e4e0-499d-af29-2697eff4db86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (6ce9e2ae-a2c5-4cc8-96cb-b8755bbd05ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:26 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-057156ab-a1ad-43d8-8606-02d5e7272cb7 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:27 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 1073741824" returned: 0 in 0.583s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:27 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 Sep 01 00:31:27 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:27 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592456961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23f61c3-8bac-40eb-a912-7c365f5a48bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:25Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume d23f61c3-8bac-40eb-a912-7c365f5a48bd {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:27 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:27 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd 1073741824 Sep 01 00:31:27 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9476cb79-b6f3-4352-927c-827bc8025e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409dfe21-4717-42df-8473-b94821121d40', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d250915-4ac8-4939-919f-c8bd777ce16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-409dfe21-4717-42df-8473-b94821121d40 (409dfe21-4717-42df-8473-b94821121d40): created successfully Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d250915-4ac8-4939-919f-c8bd777ce16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (d4057ee0-02e8-4dd9-8b05-1c9477dd7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-61bbad0e-aa82-4c6b-8f17-0349ed1c1258 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:27 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd 1073741824" returned: 0 in 0.532s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:27 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd Sep 01 00:31:27 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:28 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd" returned: 0 in 0.293s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218700985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c44b621-cc75-4e21-b2ee-06178b299d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef376331e564987b7cea5388835fd38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:26Z,use_quota=True,user_id='72e0d483f322404e9cb06e73d8c05420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Creating volume 2c44b621-cc75-4e21-b2ee-06178b299d8a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:28 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b972a72e-0570-4d26-ade2-4d2e9792e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a 1073741824 Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a15f2f-44e8-4764-8def-4d85dce0ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd (d23f61c3-8bac-40eb-a912-7c365f5a48bd): created successfully Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a15f2f-44e8-4764-8def-4d85dce0ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (357b3b29-9084-4a2a-8cbc-c0e25a447f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-95439fcb-b9b0-4b55-ac9a-9e25903c4d31 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (ec83ec4b-3b0d-4d6e-a0a1-01a91cf82a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcbfe5e-b1d7-4cd7-a124-2b2c0deae7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcbfe5e-b1d7-4cd7-a124-2b2c0deae7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878010458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d0e5da-8e6f-4805-a87a-a2d878f28cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:28Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4dd01a-acca-43e5-afcf-0269c7e6fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4dd01a-acca-43e5-afcf-0269c7e6fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d70f5c-8e41-409a-92a2-b5fa8cf80289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d70f5c-8e41-409a-92a2-b5fa8cf80289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d0e5da-8e6f-4805-a87a-a2d878f28cec', 'volume_name': 'volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876f8f33-cc45-4910-a720-4a13139ac029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876f8f33-cc45-4910-a720-4a13139ac029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88c3f5-21db-46c8-a414-84af9d4d77d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Volume 68d0e5da-8e6f-4805-a87a-a2d878f28cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec', 'volume_size': 1} Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:28 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a 1073741824" returned: 0 in 0.547s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:29 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a Sep 01 00:31:29 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:29 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878010458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d0e5da-8e6f-4805-a87a-a2d878f28cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:28Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Creating volume 68d0e5da-8e6f-4805-a87a-a2d878f28cec {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177a9093-031c-4a3d-be81-cbf6971e8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c44b621-cc75-4e21-b2ee-06178b299d8a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedaf4d4-ae86-4567-8b42-57ce9cacf137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:29 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec 1073741824 Sep 01 00:31:29 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Volume volume-2c44b621-cc75-4e21-b2ee-06178b299d8a (2c44b621-cc75-4e21-b2ee-06178b299d8a): created successfully Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cedaf4d4-ae86-4567-8b42-57ce9cacf137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Flow 'volume_create_manager' (88cf1172-be03-4202-bdc3-e63f1463ffde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-27e82c4b-d8b3-4ecc-bca9-4712f11ca562 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created volume successfully. Sep 01 00:31:29 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec 1073741824" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:30 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec Sep 01 00:31:30 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:30 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec" returned: 0 in 0.258s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88c3f5-21db-46c8-a414-84af9d4d77d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7687f48-234d-465e-9ee0-17716cf697d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Volume volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec (68d0e5da-8e6f-4805-a87a-a2d878f28cec): created successfully Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7687f48-234d-465e-9ee0-17716cf697d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (ec83ec4b-3b0d-4d6e-a0a1-01a91cf82a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-65263ab9-ad39-4009-8c45-4e027c5f9725 tempest-ProjectReaderTests-1625440428 None] Created volume successfully. Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-2c44b621-cc75-4e21-b2ee-06178b299d8a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-2c44b621-cc75-4e21-b2ee-06178b299d8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-2c44b621-cc75-4e21-b2ee-06178b299d8a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-2c44b621-cc75-4e21-b2ee-06178b299d8a" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4b1e6-f404-42c6-a996-ec91f2488854]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:30 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a Sep 01 00:31:30 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:31 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a" returned: 0 in 0.374s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:31 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a Sep 01 00:31:31 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:31 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2c44b621-cc75-4e21-b2ee-06178b299d8a" returned: 0 in 0.248s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-2c44b621-cc75-4e21-b2ee-06178b299d8a" released by "delete_volume" :: held 0.664s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['30e082b2-5d15-4e9e-a384-221d0cc84766', '8f6849f8-2c57-4830-83b8-22deee39eb23', '4dd01aa3-4990-49e1-b1b4-d405c0520406', 'e2d57a7a-b1aa-4778-9b8c-15ddbfaf1517'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:31 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:31 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:32 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-68d0e5da-8e6f-4805-a87a-a2d878f28cec-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-24788122-9bd0-4269-85d8-6ed0b706e746 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-2c44b621-cc75-4e21-b2ee-06178b299d8a-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-68d0e5da-8e6f-4805-a87a-a2d878f28cec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-d23f61c3-8bac-40eb-a912-7c365f5a48bd-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-d23f61c3-8bac-40eb-a912-7c365f5a48bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-quobyte-68d0e5da-8e6f-4805-a87a-a2d878f28cec" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-68d0e5da-8e6f-4805-a87a-a2d878f28cec" acquired by "delete_volume" :: waited 0.013s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56b41b-7ee5-4f29-ac0d-685e75a9af25]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:32 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec Sep 01 00:31:32 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:33 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec" returned: 0 in 0.383s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:33 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec Sep 01 00:31:33 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-d23f61c3-8bac-40eb-a912-7c365f5a48bd" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-d23f61c3-8bac-40eb-a912-7c365f5a48bd" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb6307-bb4e-431e-bbd3-6de69da07490]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:33 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd Sep 01 00:31:33 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:33 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-68d0e5da-8e6f-4805-a87a-a2d878f28cec" returned: 0 in 0.254s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-68d0e5da-8e6f-4805-a87a-a2d878f28cec" released by "delete_volume" :: held 0.686s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Created reservations ['65e77a17-1f19-407a-a45d-518de02b7348', '9327d148-14bd-440d-9397-d8fa93b604e8', '884ab2f6-432e-4a5a-94e5-4c039e083aa4', '6987a996-4a9a-43f0-beba-dafe4620d5c9'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:33 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:33 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd Sep 01 00:31:33 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:33 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d23f61c3-8bac-40eb-a912-7c365f5a48bd" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-d23f61c3-8bac-40eb-a912-7c365f5a48bd" released by "delete_volume" :: held 0.708s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:34 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:34 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:34 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:34 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Deleted volume successfully. Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['2cb781fd-2390-4bc0-b28e-1b09ff497d8d', '117ace08-646f-4d0f-bcba-85e38ffe7dae', 'e5a808df-8f1f-48b7-8cc9-fb1746df5a32', '8527122f-5da2-4faf-9339-f6ca314c3189'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-74275c00-c5da-4c14-b5b5-6272aa368085 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-68d0e5da-8e6f-4805-a87a-a2d878f28cec-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-409dfe21-4717-42df-8473-b94821121d40-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-409dfe21-4717-42df-8473-b94821121d40-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:34 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:34 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-409dfe21-4717-42df-8473-b94821121d40" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:34 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-409dfe21-4717-42df-8473-b94821121d40" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0fd41d-8f58-4143-8e8c-8c90445c7d70]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:35 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 Sep 01 00:31:35 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:35 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.451s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9911378b-330f-431e-9ada-898514b817ed tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-d23f61c3-8bac-40eb-a912-7c365f5a48bd-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (4c2d92a0-b12c-4ccc-9bbf-1e49cfe6f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95681e4-b916-4597-8a80-58acf780545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95681e4-b916-4597-8a80-58acf780545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-675271104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f6d2e8-e20a-4e19-a919-7d31ef0a77b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:35Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db37d71-e47d-40bd-8d93-66a41c682f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db37d71-e47d-40bd-8d93-66a41c682f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d35bb6e-4fb6-4a1f-aadf-ab74cc0bcbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d35bb6e-4fb6-4a1f-aadf-ab74cc0bcbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f6d2e8-e20a-4e19-a919-7d31ef0a77b5', 'volume_name': 'volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c47d2a-440a-40cb-a6d7-20c5b47e8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c47d2a-440a-40cb-a6d7-20c5b47e8e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b250126-fd48-4719-b624-ea5bbc5e74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:35 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Volume 34f6d2e8-e20a-4e19-a919-7d31ef0a77b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5', 'volume_size': 1} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-675271104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f6d2e8-e20a-4e19-a919-7d31ef0a77b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:35Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Creating volume 34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:35 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 1073741824 Sep 01 00:31:35 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:35 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40" returned: 0 in 0.575s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:35 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40 Sep 01 00:31:35 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:35 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-409dfe21-4717-42df-8473-b94821121d40" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-409dfe21-4717-42df-8473-b94821121d40" released by "delete_volume" :: held 0.912s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:35 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['8bdeb98f-594d-4df9-8e67-922cec8288c2', 'c74dc86f-3666-479d-9135-8dd0587f1036', '7c5cfbca-6c86-4411-bac9-3d2642fcf593', 'f4127a16-f1c6-4747-9a95-a1ff510a152b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:36 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 1073741824" returned: 0 in 0.510s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:36 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:36 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:36 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 Sep 01 00:31:36 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:36 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9d79e85a-308b-4a72-880c-9b010f96df71 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-409dfe21-4717-42df-8473-b94821121d40-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:36 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" returned: 0 in 0.369s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-4df35e6e-5a83-4a5c-8b11-efd603d4cefc-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b250126-fd48-4719-b624-ea5bbc5e74d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6c3070-abcb-421f-a71d-b689d1167c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-4df35e6e-5a83-4a5c-8b11-efd603d4cefc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Volume volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 (34f6d2e8-e20a-4e19-a919-7d31ef0a77b5): created successfully Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6c3070-abcb-421f-a71d-b689d1167c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (4c2d92a0-b12c-4ccc-9bbf-1e49cfe6f9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-56e2a71c-5d81-4ac0-8a46-58b8878742d1 tempest-ProjectReaderTests-1625440428 None] Created volume successfully. Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9117dac4-6998-4d1a-8aec-104b8b141799]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:36 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc Sep 01 00:31:36 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:37 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" returned: 0 in 0.454s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:37 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc Sep 01 00:31:37 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:37 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" returned: 0 in 0.248s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-4df35e6e-5a83-4a5c-8b11-efd603d4cefc" released by "delete_volume" :: held 0.752s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=128,cinder:UPDATE=174,cinder:DELETE=18,cinder:INSERT=36 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['35336b05-dd58-4948-aee4-8f3d138ccba3', '542f1467-ebfc-4002-96bf-c1e96e2d4407', 'ca0babbc-82e0-421c-a333-0a14c980d0ae', 'e708059e-4658-4f88-96a6-71299a3197f2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:37 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:37 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "cinder-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-quobyte-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-edc0043a-8e75-4797-8c1d-eb4c6a5ba493-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:37 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.306s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-edc0043a-8e75-4797-8c1d-eb4c6a5ba493-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[39869282-14bb-4a27-a50d-d5b6209d1f68]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93ed2b1e-d33e-4092-b3de-c9b8fc508ecc tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-4df35e6e-5a83-4a5c-8b11-efd603d4cefc-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a4583-8cc3-401b-b50c-0787bfd9426e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:37 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 Sep 01 00:31:37 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 Sep 01 00:31:38 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" returned: 0 in 0.443s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:38 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5 Sep 01 00:31:38 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" returned: 0 in 0.435s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:38 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493 Sep 01 00:31:38 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5" released by "delete_volume" :: held 0.787s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Created reservations ['d89aa921-b82c-47a6-a4df-e1261f4c8b59', '0933df75-4f52-4b4b-925a-8c445cd4886c', '3437b998-6db9-4ba9-8715-e124acf129a1', 'b7607642-08e7-49f6-82ca-62befa1ba56c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:38 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-edc0043a-8e75-4797-8c1d-eb4c6a5ba493" released by "delete_volume" :: held 0.761s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:38 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:38 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['dc241710-4a02-43cd-a00d-6449e27e5bab', '5d248cc2-12a4-4457-8e92-d4ccc751ff92', '06e9aa2d-56c7-4491-bec1-258b90ed6b95', 'e3eb1d7e-9ae2-455f-b8b6-4ee2c494104c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:38 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:38 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:38 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.294s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:38 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Deleted volume successfully. Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-d85924df-c68c-4d44-bb92-010be34728d2-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=128,cinder:UPDATE=197,cinder:INSERT=48,cinder:DELETE=15 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-59d2f20d-b6fe-4a52-8075-e90b26f882ea tempest-ProjectReaderTests-1625440428 None] Lock "cinder-34f6d2e8-e20a-4e19-a919-7d31ef0a77b5-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-d85924df-c68c-4d44-bb92-010be34728d2-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "cinder-quobyte-d85924df-c68c-4d44-bb92-010be34728d2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-d85924df-c68c-4d44-bb92-010be34728d2" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:39 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1458997-c984-4b4b-b70f-06c52fc8b84f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79467b5b-6a38-45f4-a5d8-dedabf43c5ab tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-edc0043a-8e75-4797-8c1d-eb4c6a5ba493-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:39 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 Sep 01 00:31:39 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (94a1d584-c926-46d3-970e-48cef20d690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6d25c8-5636-4ad0-995c-32b682576ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6d25c8-5636-4ad0-995c-32b682576ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179408581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfe825b-08b2-4c82-bb20-b1b7949b7425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:39Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd08599-786e-4f2c-9081-754af8c621f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd08599-786e-4f2c-9081-754af8c621f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d88001-a953-4d90-8ca3-5becd05ee2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d88001-a953-4d90-8ca3-5becd05ee2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfe825b-08b2-4c82-bb20-b1b7949b7425', 'volume_name': 'volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b262dd-c3b9-4faa-9496-2b633fd85b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b262dd-c3b9-4faa-9496-2b633fd85b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5773776-8570-49d1-a65e-314e2cf7432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Volume 8cfe825b-08b2-4c82-bb20-b1b7949b7425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425', 'volume_size': 1} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179408581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfe825b-08b2-4c82-bb20-b1b7949b7425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:39Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Creating volume 8cfe825b-08b2-4c82-bb20-b1b7949b7425 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:39 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:39 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 1073741824 Sep 01 00:31:39 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:39 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2" returned: 0 in 0.424s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:39 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2 Sep 01 00:31:39 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:39 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d85924df-c68c-4d44-bb92-010be34728d2" returned: 0 in 0.269s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-quobyte-d85924df-c68c-4d44-bb92-010be34728d2" released by "delete_volume" :: held 0.764s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Created reservations ['18b6fd2c-442e-4b24-813f-5e78cc5d13e8', '139d191f-74ab-4b13-9533-48d4047e3f3f', '6e1dbc2b-1042-4de5-943f-a1527ae01ced', '9ef67f71-f4cc-4544-b74d-a5460c798bdf'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:40 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:40 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:40 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 1073741824" returned: 0 in 0.536s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:40 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 Sep 01 00:31:40 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:40 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Deleted volume successfully. Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9a008458-b141-49f9-b57e-62102c7ab316 tempest-CreateVolumesFromSourceVolumeTest-1190359893 None] Lock "cinder-d85924df-c68c-4d44-bb92-010be34728d2-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:40 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5773776-8570-49d1-a65e-314e2cf7432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6d91f9-185f-45b9-afa9-f273e69d1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Volume volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 (8cfe825b-08b2-4c82-bb20-b1b7949b7425): created successfully Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6d91f9-185f-45b9-afa9-f273e69d1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (94a1d584-c926-46d3-970e-48cef20d690d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1d21e28d-f838-403b-be86-c391e2ea25a4 tempest-ProjectReaderTests-1625440428 None] Created volume successfully. Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-8cfe825b-08b2-4c82-bb20-b1b7949b7425-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-8cfe825b-08b2-4c82-bb20-b1b7949b7425-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-quobyte-8cfe825b-08b2-4c82-bb20-b1b7949b7425" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-8cfe825b-08b2-4c82-bb20-b1b7949b7425" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85f0d2-852e-4010-aa5c-bcfa0ec0ff65]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:42 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 Sep 01 00:31:42 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:42 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425" returned: 0 in 0.459s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:42 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425 Sep 01 00:31:42 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:42 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8cfe825b-08b2-4c82-bb20-b1b7949b7425" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-8cfe825b-08b2-4c82-bb20-b1b7949b7425" released by "delete_volume" :: held 0.807s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Created reservations ['63c01776-5f34-41e0-86af-872183b0d273', 'ebe7987c-81b4-4a3a-8a65-6a91fa85a5ac', 'a47986f1-d129-462b-9b3a-acf9c86a03c3', '420779f3-0d85-4cc6-9ee1-c1d316421f77'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:42 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:42 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:43 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.377s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Deleted volume successfully. Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe2e5102-a612-4a10-b59a-51b498dab1c6 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-8cfe825b-08b2-4c82-bb20-b1b7949b7425-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (f2e0c387-6d33-4016-960c-2052dc8d0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22220450-6b51-4253-92d1-60ce0d00ae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22220450-6b51-4253-92d1-60ce0d00ae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576927829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66705fca-7b00-4313-82ff-893e79925326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:44Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de86143-1c19-47eb-ab18-8680b5e1b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de86143-1c19-47eb-ab18-8680b5e1b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155c1a5f-929d-4b78-86ea-636eae69d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155c1a5f-929d-4b78-86ea-636eae69d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66705fca-7b00-4313-82ff-893e79925326', 'volume_name': 'volume-66705fca-7b00-4313-82ff-893e79925326', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a338788a-de61-4b0a-a254-764bfa894aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a338788a-de61-4b0a-a254-764bfa894aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f989ba-0e6a-492f-8db4-70b1c123f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:43 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Volume 66705fca-7b00-4313-82ff-893e79925326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66705fca-7b00-4313-82ff-893e79925326', 'volume_size': 1} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576927829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66705fca-7b00-4313-82ff-893e79925326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ee030eb300450db972ee21f60d6cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:44Z,use_quota=True,user_id='95913307acdc42148685e9753bc32f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Creating volume 66705fca-7b00-4313-82ff-893e79925326 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:43 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:43 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 1073741824 Sep 01 00:31:43 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Flow 'volume_create_manager' (2a8e3807-4a06-4ca3-b84c-37586f6b4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bbb021-3966-474a-8826-b0f317bde7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bbb021-3966-474a-8826-b0f317bde7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4192bc59-8704-48ff-b2a7-b1d388735ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f6abb3bf754c588017f734a5f50a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:44Z,use_quota=True,user_id='f796cef9a1e045f08ad5bc6bdd5d14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d2682e-2319-46f1-97f3-39178a629560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d2682e-2319-46f1-97f3-39178a629560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cd302f-3381-4e50-9adc-de22e43f02d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cd302f-3381-4e50-9adc-de22e43f02d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4192bc59-8704-48ff-b2a7-b1d388735ab8', 'volume_name': 'volume-4192bc59-8704-48ff-b2a7-b1d388735ab8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f03ee-284c-4add-b15e-9f29a3dc1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f03ee-284c-4add-b15e-9f29a3dc1425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97adec4-6ae4-4783-896a-c5a73a11d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Volume 4192bc59-8704-48ff-b2a7-b1d388735ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4192bc59-8704-48ff-b2a7-b1d388735ab8', 'volume_size': 1} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 1073741824" returned: 0 in 0.576s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:44 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 Sep 01 00:31:44 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:44 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326" returned: 0 in 0.254s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4192bc59-8704-48ff-b2a7-b1d388735ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f6abb3bf754c588017f734a5f50a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:44Z,use_quota=True,user_id='f796cef9a1e045f08ad5bc6bdd5d14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Creating volume 4192bc59-8704-48ff-b2a7-b1d388735ab8 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:44 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f989ba-0e6a-492f-8db4-70b1c123f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66705fca-7b00-4313-82ff-893e79925326', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 1073741824 Sep 01 00:31:44 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34963b14-b749-4e1f-86b8-45212677dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Volume volume-66705fca-7b00-4313-82ff-893e79925326 (66705fca-7b00-4313-82ff-893e79925326): created successfully Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34963b14-b749-4e1f-86b8-45212677dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Flow 'volume_create_manager' (f2e0c387-6d33-4016-960c-2052dc8d0630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8411a7fb-c9dc-42ac-861d-8ecd7288fc77 tempest-ProjectReaderTests-1625440428 None] Created volume successfully. Sep 01 00:31:45 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 1073741824" returned: 0 in 0.436s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:45 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 Sep 01 00:31:45 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:45 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8" returned: 0 in 0.254s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97adec4-6ae4-4783-896a-c5a73a11d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4192bc59-8704-48ff-b2a7-b1d388735ab8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fbb770-40c4-416d-8bed-de5495af91c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:45 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Volume volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 (4192bc59-8704-48ff-b2a7-b1d388735ab8): created successfully Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fbb770-40c4-416d-8bed-de5495af91c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Flow 'volume_create_manager' (2a8e3807-4a06-4ca3-b84c-37586f6b4a11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c82dbd3a-91a9-43a3-829c-aa13f01519ee tempest-CinderUnicodeTest-760019336 None] Created volume successfully. Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-66705fca-7b00-4313-82ff-893e79925326-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-66705fca-7b00-4313-82ff-893e79925326-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "cinder-quobyte-66705fca-7b00-4313-82ff-893e79925326" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-66705fca-7b00-4313-82ff-893e79925326" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[627bd572-812c-4136-9e4d-abd07ed2c7db]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:45 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 Sep 01 00:31:45 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:46 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:46 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326 Sep 01 00:31:46 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:46 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-66705fca-7b00-4313-82ff-893e79925326" returned: 0 in 0.282s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-quobyte-66705fca-7b00-4313-82ff-893e79925326" released by "delete_volume" :: held 0.721s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Created reservations ['6254ed94-99a0-427e-91ef-7c9933fa8e59', 'ec0bbd90-0448-40c0-a6d1-b8f787dc2022', 'a8fbe6d8-67be-46ec-a1e3-f542aeac945d', '3158e4e5-24ab-4c58-81cc-17ab16e2b193'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:46 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:46 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Flow 'volume_create_manager' (96b4a0bb-b3f2-42b3-91f5-0d8002b04ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dfc42f-0894-48de-96eb-a10e0907c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dfc42f-0894-48de-96eb-a10e0907c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1508928772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ca77e-2b26-4507-9e64-616a0a4b4cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f6abb3bf754c588017f734a5f50a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:47Z,use_quota=True,user_id='f796cef9a1e045f08ad5bc6bdd5d14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282d827e-020e-419d-b4bf-74628af63de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282d827e-020e-419d-b4bf-74628af63de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da23a7b-1ace-4d0b-9ea2-f590fac9a42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da23a7b-1ace-4d0b-9ea2-f590fac9a42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4ca77e-2b26-4507-9e64-616a0a4b4cc4', 'volume_name': 'volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902d4a58-1db2-4c82-a95d-b90deef785c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902d4a58-1db2-4c82-a95d-b90deef785c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa638e7-35dc-420f-9821-e240bb273691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Volume 3a4ca77e-2b26-4507-9e64-616a0a4b4cc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4', 'volume_size': 1} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1508928772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ca77e-2b26-4507-9e64-616a0a4b4cc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f6abb3bf754c588017f734a5f50a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:47Z,use_quota=True,user_id='f796cef9a1e045f08ad5bc6bdd5d14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Creating volume 3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:47 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:47 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 1073741824 Sep 01 00:31:47 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:47 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.359s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Deleted volume successfully. Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-810f9ce5-8f4e-4366-a344-834d43e23b63 tempest-ProjectReaderTests-1625440428 None] Lock "cinder-66705fca-7b00-4313-82ff-893e79925326-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:47 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 1073741824" returned: 0 in 0.544s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:47 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 Sep 01 00:31:47 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:47 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa638e7-35dc-420f-9821-e240bb273691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1d31c6-adeb-4d0f-a66e-7366d583a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Volume volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 (3a4ca77e-2b26-4507-9e64-616a0a4b4cc4): created successfully Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1d31c6-adeb-4d0f-a66e-7366d583a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Flow 'volume_create_manager' (96b4a0bb-b3f2-42b3-91f5-0d8002b04ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-56bb978a-de32-4284-b6ae-86da6269c7ec tempest-CinderUnicodeTest-760019336 None] Created volume successfully. Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Creating offline snapshot 163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b of volume 3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[969aab98-6564-4e36-b5d0-8ddc42a158ae]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:49 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 Sep 01 00:31:49 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:49 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" returned: 0 in 0.426s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:49 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b 1G Sep 01 00:31:49 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:50 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b 1G" returned: 0 in 0.547s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:50 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b Sep 01 00:31:50 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:50 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" returned: 0 in 0.375s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:50 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b is being set with open permissions: ugo+rw Sep 01 00:31:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:50 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b Sep 01 00:31:50 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:51 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" returned: 0 in 0.358s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:51 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info Sep 01 00:31:51 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:51 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info" returned: 0 in 0.359s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:51 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info is being set with open permissions: ugo+rw Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:51 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info Sep 01 00:31:51 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:51 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.info" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cd5d7f7d-4a5b-4d8c-9d65-00ae4c012144 tempest-CinderUnicodeTest-760019336 None] Create snapshot completed successfully Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-quobyte-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Deleting offline snapshot 163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b of volume 3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] snapshot_file for this snap is: volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed554145-1db6-44ad-aa0d-e9a58f71adb5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:52 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b Sep 01 00:31:52 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:53 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" returned: 0 in 0.468s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c150f9b-06c7-4ca9-aabf-ac4a15c514ca]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:53 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 Sep 01 00:31:53 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:53 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" returned: 0 in 0.471s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:53 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b Sep 01 00:31:53 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:54 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:54 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b Sep 01 00:31:54 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:54 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4.163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b" released by "_delete_snapshot" :: held 1.755s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" released by "delete_snapshot" :: held 1.781s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Created reservations ['9dbe7b11-17e1-4029-9324-1268cf281f51', '70f7d365-9c22-41ee-b5c0-92ec8459707c', '6153ef32-d0af-4fd8-ba05-5ec4c3fb50de', '1f670b75-30c9-4604-bdb4-fd2fb4c4b9a7'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Flow 'volume_create_manager' (a1297a76-a37b-47f8-a86e-ed6ecbb5c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59db254f-e2a0-4dc0-9cbe-ee2ba1a74ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59db254f-e2a0-4dc0-9cbe-ee2ba1a74ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1587062719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2dc454-539e-49c1-b82d-119366889cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97578ee55b9f4c9482728bcd65c35a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:54Z,use_quota=True,user_id='a5e42624e70344fc9437aa3e452e9e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7d3a61-ee41-4658-9d68-91638e1e4a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7d3a61-ee41-4658-9d68-91638e1e4a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b91c0e6-0ef6-4a55-9351-6244d17d79a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b91c0e6-0ef6-4a55-9351-6244d17d79a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2dc454-539e-49c1-b82d-119366889cdf', 'volume_name': 'volume-8b2dc454-539e-49c1-b82d-119366889cdf', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4f725a-af61-4114-abf3-30f17c9d6d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4f725a-af61-4114-abf3-30f17c9d6d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30991c27-7a85-4079-bf4a-4418d9b9c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Volume 8b2dc454-539e-49c1-b82d-119366889cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2dc454-539e-49c1-b82d-119366889cdf', 'volume_size': 1} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1587062719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2dc454-539e-49c1-b82d-119366889cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97578ee55b9f4c9482728bcd65c35a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:31:54Z,use_quota=True,user_id='a5e42624e70344fc9437aa3e452e9e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Creating volume 8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:31:54 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:54 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf 1073741824 Sep 01 00:31:54 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Delete snapshot completed successfully. Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-156c2812-a417-42b1-a4d7-b04c5ed419c1 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-163ebba9-d9f1-4a12-adc7-2d6ffcb3d79b-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3a4947-758f-4aa5-a1c9-8aa606ca8ed6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:55 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 Sep 01 00:31:55 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:55 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf 1073741824" returned: 0 in 0.570s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:55 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:31:55 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:55 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" returned: 0 in 0.457s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:55 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4 Sep 01 00:31:55 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:55 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30991c27-7a85-4079-bf4a-4418d9b9c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2dc454-539e-49c1-b82d-119366889cdf', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e73d424-7209-4e57-a179-5cc63402c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:31:55 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Volume volume-8b2dc454-539e-49c1-b82d-119366889cdf (8b2dc454-539e-49c1-b82d-119366889cdf): created successfully Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e73d424-7209-4e57-a179-5cc63402c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Flow 'volume_create_manager' (a1297a76-a37b-47f8-a86e-ed6ecbb5c839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:31:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cbbc94d5-6ac0-4e7a-9963-e43114a87862 tempest-TestStampPattern-1181022540 None] Created volume successfully. Sep 01 00:31:55 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" returned: 0 in 0.382s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4" released by "delete_volume" :: held 0.909s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Created reservations ['c5c5c503-9501-4b56-a330-0a6d8d7a6881', '01009078-2f0e-4e5a-809f-f4cb5fc33ef2', '73525194-c07c-4d1f-a85a-992f42f6a9d2', '0e57641e-083f-4430-8a77-766d07715076'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:56 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:56 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:56 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.266s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:56 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Deleted volume successfully. Sep 01 00:31:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-11b18a2a-a718-4c02-a211-12935cf77699 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-3a4ca77e-2b26-4507-9e64-616a0a4b4cc4-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-4192bc59-8704-48ff-b2a7-b1d388735ab8-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-4192bc59-8704-48ff-b2a7-b1d388735ab8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "cinder-quobyte-4192bc59-8704-48ff-b2a7-b1d388735ab8" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-4192bc59-8704-48ff-b2a7-b1d388735ab8" acquired by "delete_volume" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0fb9b-f07f-48e0-8a0c-949eaf41d836]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:57 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 Sep 01 00:31:57 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:57 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8" returned: 0 in 0.532s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:57 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8 Sep 01 00:31:57 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:58 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4192bc59-8704-48ff-b2a7-b1d388735ab8" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-quobyte-4192bc59-8704-48ff-b2a7-b1d388735ab8" released by "delete_volume" :: held 1.058s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Created reservations ['09a3f653-07fa-48a6-816d-223306322c88', 'af0d69ee-a7be-4851-a697-76064c7e9f65', 'c756e7e6-bc8a-441e-8cab-0d6508cce7a8', 'f8e5c3e3-b750-458e-8bcb-efbe5c8b897e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:31:58 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:31:58 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:31:58 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:31:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Deleted volume successfully. Sep 01 00:31:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-931d49f4-1c01-4997-958c-1da5ea199f74 tempest-CinderUnicodeTest-760019336 None] Lock "cinder-4192bc59-8704-48ff-b2a7-b1d388735ab8-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:08 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:INSERT=22,cinder:UPDATE=83,cinder:SELECT=64,cinder:DELETE=5 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:32:08 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:DELETE=8,cinder:SELECT=39,cinder:UPDATE=62,cinder:INSERT=14 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:13 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:32:13 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:13 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:32:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Flow 'volume_create_manager' (9963d786-cffc-4932-948e-8cadc38e7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c4024e-6861-42ee-9965-77bfbbc28b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c4024e-6861-42ee-9965-77bfbbc28b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1545082382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beab287-aaba-4783-a672-065889a83f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a308286a42f4abb879f32c5c6e3aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:32:15Z,use_quota=True,user_id='e535f0a0753945b1b3b86fe79f8d5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06912b64-a2a0-4315-bd07-21a8606bd645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06912b64-a2a0-4315-bd07-21a8606bd645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39bcda3-e5b0-4f05-a11f-e3168ee488a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39bcda3-e5b0-4f05-a11f-e3168ee488a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2beab287-aaba-4783-a672-065889a83f4b', 'volume_name': 'volume-2beab287-aaba-4783-a672-065889a83f4b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa39abb6-6722-4515-a678-8bcbc3544032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa39abb6-6722-4515-a678-8bcbc3544032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0bc151-18dd-47cd-8c5f-dc700431fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:15 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Volume 2beab287-aaba-4783-a672-065889a83f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2beab287-aaba-4783-a672-065889a83f4b', 'volume_size': 1} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1545082382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beab287-aaba-4783-a672-065889a83f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a308286a42f4abb879f32c5c6e3aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:32:15Z,use_quota=True,user_id='e535f0a0753945b1b3b86fe79f8d5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Creating volume 2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:32:15 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:15 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b 1073741824 Sep 01 00:32:15 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:15 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b 1073741824" returned: 0 in 0.419s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:15 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:15 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:16 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.256s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0bc151-18dd-47cd-8c5f-dc700431fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2beab287-aaba-4783-a672-065889a83f4b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2437a723-fc8f-4aed-b523-594b5fe92edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:16 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Volume volume-2beab287-aaba-4783-a672-065889a83f4b (2beab287-aaba-4783-a672-065889a83f4b): created successfully Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2437a723-fc8f-4aed-b523-594b5fe92edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Flow 'volume_create_manager' (9963d786-cffc-4932-948e-8cadc38e7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1ca9d50c-825e-4a98-a7a3-b1cbde047964 tempest-SnapshotDependencyTests-1171144008 None] Created volume successfully. Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Creating offline snapshot e822b25f-98f4-44a7-91d5-1a836b53db1b of volume 2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f226ca3-3365-4562-b312-2ab2062a0280]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:16 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:16 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:17 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:17 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b 1G Sep 01 00:32:17 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:17 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b 1G" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2beab287-aaba-4783-a672-065889a83f4b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:17 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2beab287-aaba-4783-a672-065889a83f4b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:17 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:17 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2beab287-aaba-4783-a672-065889a83f4b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:17 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b is being set with open permissions: ugo+rw Sep 01 00:32:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:17 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:17 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:18 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.251s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:18 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info Sep 01 00:32:18 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:18 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info" returned: 0 in 0.242s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:18 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info is being set with open permissions: ugo+rw Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:18 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info Sep 01 00:32:18 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:18 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.info" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-60b01059-9c66-4c89-8285-993c5532c32a tempest-SnapshotDependencyTests-1171144008 None] Create snapshot completed successfully Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Flow 'volume_create_manager' (6a6cbeee-07b6-4c6b-9c42-4c70d5584bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb4182-1080-4be1-b8f0-5a4e15aa3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbeb4182-1080-4be1-b8f0-5a4e15aa3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c77c67-fd37-4b39-80e6-cf70c84f69ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a308286a42f4abb879f32c5c6e3aaa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e822b25f-98f4-44a7-91d5-1a836b53db1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:32:19Z,use_quota=True,user_id='e535f0a0753945b1b3b86fe79f8d5951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64097f51-d4bb-403d-98ad-ab2b00394a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64097f51-d4bb-403d-98ad-ab2b00394a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d5e00e-e493-40e5-9205-8a7977281207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d5e00e-e493-40e5-9205-8a7977281207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5c77c67-fd37-4b39-80e6-cf70c84f69ab', 'volume_name': 'volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab', 'volume_size': 1, 'snapshot_id': 'e822b25f-98f4-44a7-91d5-1a836b53db1b'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53399c5b-d781-4aea-9c71-34bd10719e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53399c5b-d781-4aea-9c71-34bd10719e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba7f6e-5cf9-4fa6-9032-a7901ab5e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Volume a5c77c67-fd37-4b39-80e6-cf70c84f69ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab', 'volume_size': 1, 'snapshot_id': 'e822b25f-98f4-44a7-91d5-1a836b53db1b'} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Creating volume a5c77c67-fd37-4b39-80e6-cf70c84f69ab from snapshot e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] snapshot: e822b25f-98f4-44a7-91d5-1a836b53db1b, volume: a5c77c67-fd37-4b39-80e6-cf70c84f69ab, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63493ea-db4a-43d9-978b-6ab581b47669]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:19 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:19 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:19 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.345s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2beab287-aaba-4783-a672-065889a83f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f489de-8168-48d5-b63b-4e44f2bc371c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:20 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:20 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:20 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:32:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:32:20 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:32:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:20 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab Sep 01 00:32:20 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:24 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" returned: 0 in 4.273s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:32:24 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Converted 1024.00 MB image at 239.54 MB/s Sep 01 00:32:24 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab is being set with open permissions: ugo+rw Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:24 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab Sep 01 00:32:24 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:24 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" returned: 0 in 0.250s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" released by "_copy_volume_from_snapshot" :: held 5.300s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" released by "_create_volume_from_snapshot" :: held 5.360s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.372s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ba7f6e-5cf9-4fa6-9032-a7901ab5e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab', 'volume_size': 1, 'snapshot_id': 'e822b25f-98f4-44a7-91d5-1a836b53db1b'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f79e3f7-762c-4ac2-b338-82a71d002798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:24 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Volume volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab (a5c77c67-fd37-4b39-80e6-cf70c84f69ab): created successfully Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f79e3f7-762c-4ac2-b338-82a71d002798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:24 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Flow 'volume_create_manager' (6a6cbeee-07b6-4c6b-9c42-4c70d5584bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:24 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7ebfdddd-fab5-478e-9289-ff7edb5690f1 tempest-SnapshotDependencyTests-1171144008 None] Created volume successfully. Sep 01 00:32:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-e822b25f-98f4-44a7-91d5-1a836b53db1b-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-e822b25f-98f4-44a7-91d5-1a836b53db1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Deleting offline snapshot e822b25f-98f4-44a7-91d5-1a836b53db1b of volume 2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] snapshot_file for this snap is: volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4e516-07c2-45c0-9fab-66e2146e97e5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:26 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:26 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:26 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.380s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2beab287-aaba-4783-a672-065889a83f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c3c0b-f402-4d38-a81e-1f154d44825a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:26 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:26 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:26 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.537s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:27 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:27 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:27 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:27 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b Sep 01 00:32:27 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:27 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b.e822b25f-98f4-44a7-91d5-1a836b53db1b" returned: 0 in 0.237s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-e822b25f-98f4-44a7-91d5-1a836b53db1b" released by "_delete_snapshot" :: held 1.590s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" released by "delete_snapshot" :: held 1.615s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Created reservations ['21de9d9f-f109-4097-9faf-aa43b16c6526', 'f9774606-e757-4506-8d44-b23b0dd49f8b', 'f9201b87-2982-4349-8d64-04235b37fba8', '73bb15d0-16f5-4cb2-ac61-399ccf13a08f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:32:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Delete snapshot completed successfully. Sep 01 00:32:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4236492f-fd53-45c0-9c57-eb07b3b5c1a8 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-e822b25f-98f4-44a7-91d5-1a836b53db1b-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-2beab287-aaba-4783-a672-065889a83f4b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-2beab287-aaba-4783-a672-065889a83f4b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" acquired by "delete_volume" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf7e8ff-c0f8-4eeb-b94f-93cf8be307ab]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:28 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:28 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:28 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:28 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b Sep 01 00:32:28 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:28 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2beab287-aaba-4783-a672-065889a83f4b" returned: 0 in 0.245s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-2beab287-aaba-4783-a672-065889a83f4b" released by "delete_volume" :: held 0.655s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:28 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Created reservations ['53a4c1e8-51fd-4582-85e2-1b4fde6986b4', 'fa3474d4-dd74-4f4c-8337-9da0d3344d01', '237a4d32-f6af-4fc8-9a0a-086a4980cc70', 'cd7f0ed2-5e1e-4f06-984b-09879a38a0b8'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:29 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:32:29 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-a5c77c67-fd37-4b39-80e6-cf70c84f69ab-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-a5c77c67-fd37-4b39-80e6-cf70c84f69ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:29 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:32:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Deleted volume successfully. Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[60478daa-5a29-448b-9f32-140073a0a9fa]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5b7d19c8-e807-4f0c-ab68-5e4ae35af182 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-2beab287-aaba-4783-a672-065889a83f4b-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:29 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab Sep 01 00:32:29 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:30 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:30 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab Sep 01 00:32:30 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:30 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" returned: 0 in 0.250s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-quobyte-a5c77c67-fd37-4b39-80e6-cf70c84f69ab" released by "delete_volume" :: held 0.643s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:30 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Created reservations ['bda98e9f-5212-408d-8083-e1d20e68fb32', '89d2ee10-8f5f-4fc8-9176-24a69d21216c', 'da36ab37-39de-4ee7-8fcd-9de0019af85b', '73a0e1a7-a8da-4801-9a3b-511d4280c84b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:31 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:32:31 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:31 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.253s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:32:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Deleted volume successfully. Sep 01 00:32:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dc9c4cce-5030-4bdc-a95f-cbf427e88589 tempest-SnapshotDependencyTests-1171144008 None] Lock "cinder-a5c77c67-fd37-4b39-80e6-cf70c84f69ab-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef1df3bd-6a22-4d62-abdc-d7a9ee165f9c req-2b12a53b-7596-4a40-a14b-9f34b4bbfbe3 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef1df3bd-6a22-4d62-abdc-d7a9ee165f9c req-2b12a53b-7596-4a40-a14b-9f34b4bbfbe3 tempest-TestStampPattern-1181022540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-ef1df3bd-6a22-4d62-abdc-d7a9ee165f9c req-2b12a53b-7596-4a40-a14b-9f34b4bbfbe3 tempest-TestStampPattern-1181022540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-ef1df3bd-6a22-4d62-abdc-d7a9ee165f9c req-2b12a53b-7596-4a40-a14b-9f34b4bbfbe3 tempest-TestStampPattern-1181022540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-8b2dc454-539e-49c1-b82d-119366889cdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e50d448-a16c-41b8-b704-30d987de6626', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:32:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-ef1df3bd-6a22-4d62-abdc-d7a9ee165f9c req-2b12a53b-7596-4a40-a14b-9f34b4bbfbe3 tempest-TestStampPattern-1181022540 None] attachment_update completed successfully. Sep 01 00:32:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-45c04c5b-9a3c-4e20-a81c-2ca17e9fde97 req-6d789218-12e4-4c62-988b-da9a14af2780 tempest-TestStampPattern-1181022540 None] Terminate volume connection completed successfully. Sep 01 00:32:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-45c04c5b-9a3c-4e20-a81c-2ca17e9fde97 req-6d789218-12e4-4c62-988b-da9a14af2780 tempest-TestStampPattern-1181022540 None] Deleting attachment 9e50d448-a16c-41b8-b704-30d987de6626. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Creating offline snapshot afcbdc24-c6d8-42f2-b75d-554378d585e3 of volume 8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8c86de-81a0-4bc0-85d3-1881da01e942]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:38 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:32:38 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:38 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:38 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 1G Sep 01 00:32:38 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:38 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 1G" returned: 0 in 0.395s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2dc454-539e-49c1-b82d-119366889cdf -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:38 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2dc454-539e-49c1-b82d-119366889cdf -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:32:38 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:39 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2dc454-539e-49c1-b82d-119366889cdf -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.289s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:39 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 is being set with open permissions: ugo+rw Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:39 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:32:39 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:39 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:39 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info Sep 01 00:32:39 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:39 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info" returned: 0 in 0.238s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:39 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info is being set with open permissions: ugo+rw Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:39 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info Sep 01 00:32:39 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:39 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.info" returned: 0 in 0.244s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6460903d-0102-42ac-93ed-9b712408f51b tempest-TestStampPattern-1181022540 None] Create snapshot completed successfully Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Flow 'volume_create_manager' (1aa988d9-f002-4f60-8120-d5b9d339641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde7d07-a659-44b4-8bc3-eb3ddc909245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fde7d07-a659-44b4-8bc3-eb3ddc909245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-916417500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e9be2f-d8e7-4904-9fba-14d7280fad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97578ee55b9f4c9482728bcd65c35a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=afcbdc24-c6d8-42f2-b75d-554378d585e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:32:47Z,use_quota=True,user_id='a5e42624e70344fc9437aa3e452e9e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b931f229-d8b5-4575-8a32-476db0d17695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b931f229-d8b5-4575-8a32-476db0d17695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a26281-57e0-4297-875b-1a5dc45a3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a26281-57e0-4297-875b-1a5dc45a3284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4e9be2f-d8e7-4904-9fba-14d7280fad71', 'volume_name': 'volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71', 'volume_size': 1, 'snapshot_id': 'afcbdc24-c6d8-42f2-b75d-554378d585e3'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa68f6e-d2f2-47df-84c1-0485a9f55399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa68f6e-d2f2-47df-84c1-0485a9f55399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4abef5-4e06-4a9c-9da5-e4434548b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Volume f4e9be2f-d8e7-4904-9fba-14d7280fad71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71', 'volume_size': 1, 'snapshot_id': 'afcbdc24-c6d8-42f2-b75d-554378d585e3'} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3-f4e9be2f-d8e7-4904-9fba-14d7280fad71" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3-f4e9be2f-d8e7-4904-9fba-14d7280fad71" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Creating volume f4e9be2f-d8e7-4904-9fba-14d7280fad71 from snapshot afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] snapshot: afcbdc24-c6d8-42f2-b75d-554378d585e3, volume: f4e9be2f-d8e7-4904-9fba-14d7280fad71, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceff8ee-a665-40ee-997d-d593b5d46bca]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:47 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:32:47 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:47 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.384s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2dc454-539e-49c1-b82d-119366889cdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b2c4d5-fe8c-44cc-93c0-d9ff1c8d6a09]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:47 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:32:47 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:47 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:32:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:47 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 Sep 01 00:32:47 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:53 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71" returned: 0 in 5.729s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:53 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:32:53 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Converted 1024.00 MB image at 178.72 MB/s Sep 01 00:32:53 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 is being set with open permissions: ugo+rw Sep 01 00:32:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:32:53 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 Sep 01 00:32:53 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:32:53 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 01 00:32:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:32:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" released by "_copy_volume_from_snapshot" :: held 6.906s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3-f4e9be2f-d8e7-4904-9fba-14d7280fad71" released by "_create_volume_from_snapshot" :: held 6.968s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.984s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4abef5-4e06-4a9c-9da5-e4434548b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71', 'volume_size': 1, 'snapshot_id': 'afcbdc24-c6d8-42f2-b75d-554378d585e3'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec0232a-a0b7-4db2-ae9b-aa022ed8d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:32:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Volume volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 (f4e9be2f-d8e7-4904-9fba-14d7280fad71): created successfully Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec0232a-a0b7-4db2-ae9b-aa022ed8d72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:32:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Flow 'volume_create_manager' (1aa988d9-f002-4f60-8120-d5b9d339641b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:32:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-eb9fa24d-3d71-426c-a8f1-1f44864929b0 tempest-TestStampPattern-1181022540 None] Created volume successfully. Sep 01 00:33:04 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:33:06 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=34,cinder:SELECT=40,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:13 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:33:13 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:13 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.237s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:33:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:33:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-071934d1-f5df-4475-ae26-349ea6a28a13 req-464e1788-0b45-41e5-a6f6-17ee49bb1f27 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:33:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-071934d1-f5df-4475-ae26-349ea6a28a13 req-464e1788-0b45-41e5-a6f6-17ee49bb1f27 tempest-TestStampPattern-1181022540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:33:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [req-071934d1-f5df-4475-ae26-349ea6a28a13 req-464e1788-0b45-41e5-a6f6-17ee49bb1f27 tempest-TestStampPattern-1181022540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:33:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-071934d1-f5df-4475-ae26-349ea6a28a13 req-464e1788-0b45-41e5-a6f6-17ee49bb1f27 tempest-TestStampPattern-1181022540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6', 'name': 'volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '199cc727-98cd-487b-9451-fbc31436b5e5', 'enforce_multipath': True} {{(pid=87803) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 00:33:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-071934d1-f5df-4475-ae26-349ea6a28a13 req-464e1788-0b45-41e5-a6f6-17ee49bb1f27 tempest-TestStampPattern-1181022540 None] attachment_update completed successfully. Sep 01 00:33:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [req-551db00f-d409-4287-b9f6-96ab28a20dda req-79d391d0-6235-4e9e-ab5a-51d5a6872eb1 tempest-TestStampPattern-1181022540 None] Terminate volume connection completed successfully. Sep 01 00:33:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [req-551db00f-d409-4287-b9f6-96ab28a20dda req-79d391d0-6235-4e9e-ab5a-51d5a6872eb1 tempest-TestStampPattern-1181022540 None] Deleting attachment 199cc727-98cd-487b-9451-fbc31436b5e5. {{(pid=87803) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-f4e9be2f-d8e7-4904-9fba-14d7280fad71-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "cinder-f4e9be2f-d8e7-4904-9fba-14d7280fad71-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2561efd5-0eb1-4a3f-a25c-646711cefc56]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:42 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 Sep 01 00:33:42 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:42 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71" returned: 0 in 0.365s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:42 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71 Sep 01 00:33:42 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:42 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f4e9be2f-d8e7-4904-9fba-14d7280fad71" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-f4e9be2f-d8e7-4904-9fba-14d7280fad71" released by "delete_volume" :: held 0.664s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Created reservations ['c4fd00b4-f495-433d-be31-6ce5ba99c165', '4a739d10-af01-4d4e-9bf1-1453343f3808', '5f0e5c6a-cdbe-49fb-884f-2ef45ef7b70c', 'd246e1c7-5810-415f-a195-b1e551fd9b77'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:33:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:43 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:33:43 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:43 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:33:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Deleted volume successfully. Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-dfaf0ff9-ea9d-458f-8861-936c26408ff0 tempest-TestStampPattern-1181022540 None] Lock "cinder-f4e9be2f-d8e7-4904-9fba-14d7280fad71-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-afcbdc24-c6d8-42f2-b75d-554378d585e3-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-afcbdc24-c6d8-42f2-b75d-554378d585e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Deleting offline snapshot afcbdc24-c6d8-42f2-b75d-554378d585e3 of volume 8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] snapshot_file for this snap is: volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e008ec8-163d-4995-b6e1-f64d5f06ccf5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:33:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:43 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:33:43 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:44 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.363s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2dc454-539e-49c1-b82d-119366889cdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef44f648-303f-4af5-915e-55b26c10dba4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:44 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:33:44 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:44 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.515s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:44 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:33:44 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:44 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:44 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3 Sep 01 00:33:44 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:45 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf.afcbdc24-c6d8-42f2-b75d-554378d585e3" returned: 0 in 0.236s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-afcbdc24-c6d8-42f2-b75d-554378d585e3" released by "_delete_snapshot" :: held 1.522s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" released by "delete_snapshot" :: held 1.547s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:45 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Created reservations ['2d297a3f-cbd8-48cf-8fda-d9228586adb7', 'd61f2cf0-36d6-43ad-8884-8e56dab859b8', '0b8fbd7c-8a48-4f20-9a71-22cc856b9609', '8b73e648-4e3c-4a08-acca-a420f767ca2b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:33:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Delete snapshot completed successfully. Sep 01 00:33:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d22fb87c-249b-44e6-adc2-2d877dd10810 tempest-TestStampPattern-1181022540 None] Lock "cinder-afcbdc24-c6d8-42f2-b75d-554378d585e3-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-8b2dc454-539e-49c1-b82d-119366889cdf-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "cinder-8b2dc454-539e-49c1-b82d-119366889cdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Acquiring lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" acquired by "delete_volume" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e67dda-3a5c-407d-8761-f9b2bab300a6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:49 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:33:49 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:49 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.363s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:49 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf Sep 01 00:33:49 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:49 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b2dc454-539e-49c1-b82d-119366889cdf" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "cinder-quobyte-8b2dc454-539e-49c1-b82d-119366889cdf" released by "delete_volume" :: held 0.681s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Created reservations ['4b14cc77-8ecc-4090-98f8-c4fc1f2fcad6', '98a72444-09d9-4c7a-9328-cd383052e2ac', '427b1752-cf94-4daa-ab9f-72ebe70972eb', 'c1a83df6-cbb4-49fc-966b-e68cf2ea13f3'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:33:50 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:33:50 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:33:50 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:33:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Deleted volume successfully. Sep 01 00:33:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-52bec688-3253-42b4-848f-0628d0e09300 tempest-TestStampPattern-1181022540 None] Lock "cinder-8b2dc454-539e-49c1-b82d-119366889cdf-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:00 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=7 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:34:00 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Flow 'volume_create_manager' (261689bf-d2ee-47a5-8a72-278d32be9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017d0bd-c655-4378-869a-2b68e272deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017d0bd-c655-4378-869a-2b68e272deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e792e175-c51e-444d-8d5c-e48d216b2ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39557c3154149d39bfadbbe3ac5af03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:04Z,use_quota=True,user_id='3007825c542841f3b25bd0ae1df6f631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e63b05-56a5-49e6-9da8-6e9145eaf2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e63b05-56a5-49e6-9da8-6e9145eaf2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a67a0-3295-46bd-9137-73399ff6de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82a67a0-3295-46bd-9137-73399ff6de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e792e175-c51e-444d-8d5c-e48d216b2ba9', 'volume_name': 'volume-e792e175-c51e-444d-8d5c-e48d216b2ba9', 'volume_size': 1, 'image_id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0ac54947710c1956a62c13754641337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a39557c3154149d39bfadbbe3ac5af03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13a9a6bacf8f2cccab085451f2756e83b390aac697f72fba22774473e02b195fed74d786cda28abeab5605697b663d1456feb8e7fc25c37186eab736fe91c127', 'id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2e6332-4560-4755-b645-ba25a18b07a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2e6332-4560-4755-b645-ba25a18b07a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4103693b-b6c7-4320-8c15-c2dfbaec4dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Volume e792e175-c51e-444d-8d5c-e48d216b2ba9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e792e175-c51e-444d-8d5c-e48d216b2ba9', 'volume_size': 1, 'image_id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0ac54947710c1956a62c13754641337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a39557c3154149d39bfadbbe3ac5af03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13a9a6bacf8f2cccab085451f2756e83b390aac697f72fba22774473e02b195fed74d786cda28abeab5605697b663d1456feb8e7fc25c37186eab736fe91c127', 'id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4/file', 'properties': {}}, 'image_service': } Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Trying to clone e792e175-c51e-444d-8d5c-e48d216b2ba9 from image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:34:04 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Image download 0.00 MB at 0.00 MB/s Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb7012c-d84c-46bb-adbb-a8412dd7984f]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:04 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:04 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:04 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:04 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:04 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:05 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Temporary image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 is fetched for user 3007825c542841f3b25bd0ae1df6f631. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9680491-3776-49b3-ae6c-cb8b6de25129]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:05 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:05 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:05 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:05 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:05 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:05 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e792e175-c51e-444d-8d5c-e48d216b2ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39557c3154149d39bfadbbe3ac5af03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:04Z,use_quota=True,user_id='3007825c542841f3b25bd0ae1df6f631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Creating volume e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:05 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:06 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1073741824 Sep 01 00:34:06 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:06 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1073741824" returned: 0 in 0.404s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:06 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 Sep 01 00:34:06 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:06 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9" returned: 0 in 0.238s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Attempting download of 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}])) to volume e792e175-c51e-444d-8d5c-e48d216b2ba9. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588b564-b095-45ee-9247-875a913ea7e5]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:06 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808 Sep 01 00:34:06 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:07 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808" returned: 0 in 0.330s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:07 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808 Sep 01 00:34:07 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:07 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808" returned: 1 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_b4u0u808' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea773d-c39d-4a09-8461-b854156c9f78]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:07 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:07 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:07 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:07 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD Sep 01 00:34:07 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:08 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 was raw, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:08 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 Sep 01 00:34:08 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:08 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d500eaf-02d8-4443-b0ac-121c50d7d4d4_xlozzyx1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:34:08 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:08 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1G Sep 01 00:34:08 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:08 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 1G" returned: 0 in 0.299s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Downloaded image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}])) to volume e792e175-c51e-444d-8d5c-e48d216b2ba9 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Temporary image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 for user 3007825c542841f3b25bd0ae1df6f631 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Marking volume e792e175-c51e-444d-8d5c-e48d216b2ba9 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Copying metadata from image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 to e792e175-c51e-444d-8d5c-e48d216b2ba9. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Creating volume glance metadata for volume e792e175-c51e-444d-8d5c-e48d216b2ba9 backed by image 5d500eaf-02d8-4443-b0ac-121c50d7d4d4 with: {'image_id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd0ac54947710c1956a62c13754641337', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4103693b-b6c7-4320-8c15-c2dfbaec4dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e792e175-c51e-444d-8d5c-e48d216b2ba9', 'volume_size': 1, 'image_id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0ac54947710c1956a62c13754641337', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a39557c3154149d39bfadbbe3ac5af03', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13a9a6bacf8f2cccab085451f2756e83b390aac697f72fba22774473e02b195fed74d786cda28abeab5605697b663d1456feb8e7fc25c37186eab736fe91c127', 'id': '5d500eaf-02d8-4443-b0ac-121c50d7d4d4', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d500eaf-02d8-4443-b0ac-121c50d7d4d4/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12918598-4159-457d-bd88-458611f8ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:08 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Volume volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 (e792e175-c51e-444d-8d5c-e48d216b2ba9): created successfully Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12918598-4159-457d-bd88-458611f8ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Flow 'volume_create_manager' (261689bf-d2ee-47a5-8a72-278d32be9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:08 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6084c3f3-2d7a-4ed5-9329-9edd0b4c8bf8 tempest-VolumeImageDependencyTests-344816064 None] Created volume successfully. Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Acquiring lock "cinder-e792e175-c51e-444d-8d5c-e48d216b2ba9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "cinder-e792e175-c51e-444d-8d5c-e48d216b2ba9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Acquiring lock "cinder-quobyte-e792e175-c51e-444d-8d5c-e48d216b2ba9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "cinder-quobyte-e792e175-c51e-444d-8d5c-e48d216b2ba9" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99236fb-b0d4-4b94-89cc-cd4210f9f02b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:09 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 Sep 01 00:34:09 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:09 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:09 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9 Sep 01 00:34:09 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:10 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e792e175-c51e-444d-8d5c-e48d216b2ba9" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "cinder-quobyte-e792e175-c51e-444d-8d5c-e48d216b2ba9" released by "delete_volume" :: held 0.680s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Created reservations ['5b4ccd07-1389-4666-a8a6-5d84f62c5b6f', '959481c1-5669-4a7b-94c5-7aee43752eda', '1b4eefc9-4f60-4238-9a3a-a5113db5c1e4', '659f4ee9-e7c9-400d-b653-4c22517fb548'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:10 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:10 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:10 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Deleted volume successfully. Sep 01 00:34:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-66b6ae0c-c715-4729-806f-dc845b831bfa tempest-VolumeImageDependencyTests-344816064 None] Lock "cinder-e792e175-c51e-444d-8d5c-e48d216b2ba9-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:13 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:13 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:13 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.262s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:34:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:34:20 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:34:20 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=14,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (7310a782-1dd4-4eeb-aa1f-2f1937c25c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c852c40-e959-4f98-bf8f-27cf39057db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c852c40-e959-4f98-bf8f-27cf39057db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448357823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651d41c4-8d50-4b16-a51f-e85cde66013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:27Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2749f688-6cfe-4438-a4c9-2efc46e44779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2749f688-6cfe-4438-a4c9-2efc46e44779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fbed49-4424-4acb-b28e-55bb01a1f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fbed49-4424-4acb-b28e-55bb01a1f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651d41c4-8d50-4b16-a51f-e85cde66013a', 'volume_name': 'volume-651d41c4-8d50-4b16-a51f-e85cde66013a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfac1817-2b75-4108-964e-9de5bb9702cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfac1817-2b75-4108-964e-9de5bb9702cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b321ec89-a1f2-4949-81ce-8e839822549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume 651d41c4-8d50-4b16-a51f-e85cde66013a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651d41c4-8d50-4b16-a51f-e85cde66013a', 'volume_size': 1} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448357823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651d41c4-8d50-4b16-a51f-e85cde66013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:27Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume 651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:27 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:27 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a 1073741824 Sep 01 00:34:27 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (ff9e5998-05e8-4b4a-952d-0196fab9dfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612820ee-43cc-4395-9685-b68bd096dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612820ee-43cc-4395-9685-b68bd096dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-709918362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e3360-0dde-4127-8709-94cd905756a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:27Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685d1e4-e37a-44e6-84f0-4a0b59a77e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9685d1e4-e37a-44e6-84f0-4a0b59a77e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593324d5-71f5-4004-b75e-7f35cf5ff86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593324d5-71f5-4004-b75e-7f35cf5ff86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7e3360-0dde-4127-8709-94cd905756a2', 'volume_name': 'volume-7b7e3360-0dde-4127-8709-94cd905756a2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53550b72-008a-4bd4-b1e7-ec877b295461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53550b72-008a-4bd4-b1e7-ec877b295461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111bff7a-f424-4264-87bf-e94dfbc64de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 7b7e3360-0dde-4127-8709-94cd905756a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7e3360-0dde-4127-8709-94cd905756a2', 'volume_size': 1} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (ceabfe16-650b-4b0b-a153-4added6bbe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3e7bf-9433-4c0f-bf99-3113534564b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3e7bf-9433-4c0f-bf99-3113534564b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236002828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a98a33-35ac-4062-b4ab-4592fdf994d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:28Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae9e30c-19ed-44c9-842a-c205d93208df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae9e30c-19ed-44c9-842a-c205d93208df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf6b1b6-02c0-4d1f-a34e-1d777a28619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf6b1b6-02c0-4d1f-a34e-1d777a28619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a98a33-35ac-4062-b4ab-4592fdf994d9', 'volume_name': 'volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29bf81-af09-46c3-adea-32a384562dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29bf81-af09-46c3-adea-32a384562dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd444cdb-4144-4d14-b0cf-7ab4351e0e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:27 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Volume c8a98a33-35ac-4062-b4ab-4592fdf994d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9', 'volume_size': 1} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a 1073741824" returned: 0 in 0.627s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:28 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a Sep 01 00:34:28 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (36fd0081-35f1-404c-9847-b68105669a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9902d0-4a4d-45d8-9e19-f28433ce1489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-709918362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e3360-0dde-4127-8709-94cd905756a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:27Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 7b7e3360-0dde-4127-8709-94cd905756a2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:28 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9902d0-4a4d-45d8-9e19-f28433ce1489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769413028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ee563d-655b-480a-b053-dea1a6660541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:28Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe964c7-1001-4315-9cd7-2d708b9a46e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 1073741824 Sep 01 00:34:28 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe964c7-1001-4315-9cd7-2d708b9a46e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4156cfd-2fcf-4a2e-a49f-a98549578b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4156cfd-2fcf-4a2e-a49f-a98549578b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ee563d-655b-480a-b053-dea1a6660541', 'volume_name': 'volume-85ee563d-655b-480a-b053-dea1a6660541', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8964b98b-3b3c-489d-89de-d63b2b37d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8964b98b-3b3c-489d-89de-d63b2b37d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0229a9cd-f172-496b-8c40-1023b28a443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Volume 85ee563d-655b-480a-b053-dea1a6660541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ee563d-655b-480a-b053-dea1a6660541', 'volume_size': 1} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b321ec89-a1f2-4949-81ce-8e839822549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651d41c4-8d50-4b16-a51f-e85cde66013a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ec71df-9a0b-4af5-8bf9-9731b8a6ea24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-651d41c4-8d50-4b16-a51f-e85cde66013a (651d41c4-8d50-4b16-a51f-e85cde66013a): created successfully Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ec71df-9a0b-4af5-8bf9-9731b8a6ea24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (7310a782-1dd4-4eeb-aa1f-2f1937c25c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0c7b7c22-b0e3-4630-8234-fec10f808be6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (ba191f18-dbb4-4b87-8913-344765cbf438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646181d8-0f8f-43ac-b671-ce8a08411cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646181d8-0f8f-43ac-b671-ce8a08411cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111303172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:29Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf5ce8b-eb9d-477a-a35c-cbbac37eda21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf5ce8b-eb9d-477a-a35c-cbbac37eda21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fca665c-3e07-4cb1-b70b-de3aed55ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fca665c-3e07-4cb1-b70b-de3aed55ea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9', 'volume_name': 'volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e275e-f4b9-49fc-bee3-0a803af08bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46e275e-f4b9-49fc-bee3-0a803af08bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95391265-7d72-4922-8715-c041db93c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Volume 360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9', 'volume_size': 1} Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:28 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 1073741824" returned: 0 in 0.620s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:29 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 Sep 01 00:34:29 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (d861c9c7-62cf-467f-863b-e059f7e2c661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b5e858-6214-469e-8a67-f5dacc8e6b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b5e858-6214-469e-8a67-f5dacc8e6b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882655673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e911b8-40ae-4e1d-8c2f-63642a1630a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:29Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263e7e7-046c-4cbe-bbe6-57d06350c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8263e7e7-046c-4cbe-bbe6-57d06350c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aec7fcf-79e5-4da3-a7f2-9217e3c32743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aec7fcf-79e5-4da3-a7f2-9217e3c32743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e911b8-40ae-4e1d-8c2f-63642a1630a2', 'volume_name': 'volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ded1ec-fb64-4e83-9055-5c54548fb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ded1ec-fb64-4e83-9055-5c54548fb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dd5672-91ef-4d30-b6f0-fb2b8794b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Volume 35e911b8-40ae-4e1d-8c2f-63642a1630a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2', 'volume_size': 1} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:29 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2" returned: 0 in 0.393s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236002828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a98a33-35ac-4062-b4ab-4592fdf994d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:28Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Creating volume c8a98a33-35ac-4062-b4ab-4592fdf994d9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111bff7a-f424-4264-87bf-e94dfbc64de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7e3360-0dde-4127-8709-94cd905756a2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79b8ff-589f-429b-bb43-7eea0adcda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:29 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 1073741824 Sep 01 00:34:29 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-7b7e3360-0dde-4127-8709-94cd905756a2 (7b7e3360-0dde-4127-8709-94cd905756a2): created successfully Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79b8ff-589f-429b-bb43-7eea0adcda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (ff9e5998-05e8-4b4a-952d-0196fab9dfea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1589c945-c688-4330-b027-9e1857763e22 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:29 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:29 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (b2d0cec7-4fd9-4d4e-8b85-43883e24dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cf557f-0082-436e-8194-02122712d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 1073741824" returned: 0 in 0.615s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cf557f-0082-436e-8194-02122712d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191697401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aede659-bb51-4ff0-834d-b029b5d3fca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:30Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b0fcc-a297-42c4-a01a-b1c63fd1fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b0fcc-a297-42c4-a01a-b1c63fd1fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c2b1fa-0ba2-4de7-9da8-78872da7526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c2b1fa-0ba2-4de7-9da8-78872da7526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aede659-bb51-4ff0-834d-b029b5d3fca4', 'volume_name': 'volume-7aede659-bb51-4ff0-834d-b029b5d3fca4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91182ae-4725-43ac-b781-03490472e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91182ae-4725-43ac-b781-03490472e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a69515-4a06-45d4-bc6b-cf86cb1467c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Volume 7aede659-bb51-4ff0-834d-b029b5d3fca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aede659-bb51-4ff0-834d-b029b5d3fca4', 'volume_size': 1} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:30 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 Sep 01 00:34:30 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:30 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.965s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1769413028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ee563d-655b-480a-b053-dea1a6660541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:28Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Creating volume 85ee563d-655b-480a-b053-dea1a6660541 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:30 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd444cdb-4144-4d14-b0cf-7ab4351e0e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 1073741824 Sep 01 00:34:30 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c31c6f-6922-44e1-94ee-5d5e43fd13ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Volume volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 (c8a98a33-35ac-4062-b4ab-4592fdf994d9): created successfully Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c31c6f-6922-44e1-94ee-5d5e43fd13ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (ceabfe16-650b-4b0b-a153-4added6bbe62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-17420793-8517-4f25-a523-041aebcea14e tempest-CreateVolumesFromImageTest-601090492 None] Created volume successfully. Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:30 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (c41eecb8-a23c-4654-ae82-dc68bb99af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b26dd9b-8233-4f51-9f4e-ab4ae0e8a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 1073741824" returned: 0 in 0.603s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b26dd9b-8233-4f51-9f4e-ab4ae0e8a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143382247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6330594f-3f83-40ed-8a2d-f8994452efe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:31Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d3839b-8e68-4392-850d-c10168333d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d3839b-8e68-4392-850d-c10168333d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5562e792-5ec9-4ae1-a788-72452d5e21c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5562e792-5ec9-4ae1-a788-72452d5e21c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6330594f-3f83-40ed-8a2d-f8994452efe9', 'volume_name': 'volume-6330594f-3f83-40ed-8a2d-f8994452efe9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe274fe-9244-4631-b188-16db056522fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe274fe-9244-4631-b188-16db056522fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b209ff70-2357-4e5b-b07e-726981bbc9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 6330594f-3f83-40ed-8a2d-f8994452efe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6330594f-3f83-40ed-8a2d-f8994452efe9', 'volume_size': 1} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:31 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 Sep 01 00:34:31 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (d2b7bc4e-dfe4-4f73-9cee-be242c1fa7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c632bc-51ff-4298-a7b3-236cc0225174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c632bc-51ff-4298-a7b3-236cc0225174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884222760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513986fc-3028-44f9-9cc2-119d6a9591e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:31Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03e2003-53d0-4f7e-9d35-935f64a82abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03e2003-53d0-4f7e-9d35-935f64a82abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9a398-72dd-41af-80e6-885f5c302ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9a398-72dd-41af-80e6-885f5c302ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513986fc-3028-44f9-9cc2-119d6a9591e7', 'volume_name': 'volume-513986fc-3028-44f9-9cc2-119d6a9591e7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ca5eee-73ea-40e3-914a-1357c4fa9288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ca5eee-73ea-40e3-914a-1357c4fa9288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ab3938-47dc-49df-b6a9-f062c748825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 513986fc-3028-44f9-9cc2-119d6a9591e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513986fc-3028-44f9-9cc2-119d6a9591e7', 'volume_size': 1} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-111303172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:29Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Creating volume 360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0229a9cd-f172-496b-8c40-1023b28a443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ee563d-655b-480a-b053-dea1a6660541', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b83b3a-754c-4af1-bc2b-31d591acda43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 1073741824 Sep 01 00:34:31 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Volume volume-85ee563d-655b-480a-b053-dea1a6660541 (85ee563d-655b-480a-b053-dea1a6660541): created successfully Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b83b3a-754c-4af1-bc2b-31d591acda43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (36fd0081-35f1-404c-9847-b68105669a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-00b57889-37d3-4827-9d1b-0127cfa0dbd1 tempest-CreateVolumesFromImageTest-601090492 None] Created volume successfully. Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (ebbb7949-b4d7-45dc-8e43-1471fe3a7366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967c084-aec9-4430-83b8-7c93662ab0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967c084-aec9-4430-83b8-7c93662ab0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100513445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585cd619-a533-445f-acb5-045ac3eabf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:32Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a548bad-07fa-4c4c-9031-e15bdaaff60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a548bad-07fa-4c4c-9031-e15bdaaff60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287852a5-c121-45ab-843d-3d1e65e8a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287852a5-c121-45ab-843d-3d1e65e8a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585cd619-a533-445f-acb5-045ac3eabf16', 'volume_name': 'volume-585cd619-a533-445f-acb5-045ac3eabf16', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda1e770-d7f9-4abd-8edc-1f39d1652038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda1e770-d7f9-4abd-8edc-1f39d1652038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033f498c-499a-41f4-970a-c129c2529b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:31 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 585cd619-a533-445f-acb5-045ac3eabf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585cd619-a533-445f-acb5-045ac3eabf16', 'volume_size': 1} Sep 01 00:34:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:32 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 1073741824" returned: 0 in 0.681s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:32 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 Sep 01 00:34:32 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:32 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (5447d9aa-5aaa-4d94-82b4-9bcce18277b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9557aa-72d2-47a2-ae23-5aed0e499b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" returned: 0 in 0.382s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882655673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e911b8-40ae-4e1d-8c2f-63642a1630a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:29Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Creating volume 35e911b8-40ae-4e1d-8c2f-63642a1630a2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:32 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9557aa-72d2-47a2-ae23-5aed0e499b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960883342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62386a31-18a8-4f38-9ff7-769e187bab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:32Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dbd394-11c5-4c87-93a0-1e93f7ce3ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 1073741824 Sep 01 00:34:32 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dbd394-11c5-4c87-93a0-1e93f7ce3ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7afa960-7251-46c3-90db-c15245764ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7afa960-7251-46c3-90db-c15245764ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62386a31-18a8-4f38-9ff7-769e187bab5d', 'volume_name': 'volume-62386a31-18a8-4f38-9ff7-769e187bab5d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c4d3a8-8a95-43d1-8b5b-aa4c0128cef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c4d3a8-8a95-43d1-8b5b-aa4c0128cef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa9ffe6-3fa7-4898-8fdf-5c599df1086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 62386a31-18a8-4f38-9ff7-769e187bab5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62386a31-18a8-4f38-9ff7-769e187bab5d', 'volume_size': 1} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95391265-7d72-4922-8715-c041db93c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb8854-b3ad-4e4e-8fd3-a3e9501cc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Flow 'volume_create_manager' (af981407-0053-4295-8b79-4676df2ff142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9968605a-9bb0-4c09-8140-cef4da4524d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Volume volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 (360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9): created successfully Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cb8854-b3ad-4e4e-8fd3-a3e9501cc483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (ba191f18-dbb4-4b87-8913-344765cbf438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9968605a-9bb0-4c09-8140-cef4da4524d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea73b81-9afa-4f8b-bc34-00462d7df513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec61faacd0b4a779d38bb1b38870222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:33Z,use_quota=True,user_id='19d56d9e0a4645beac2e710f78d65db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75d682c-f21a-49bd-80e9-7ce67a7b760e),volume_type_id=f75d682c-f21a-49bd-80e9-7ce67a7b760e)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ab62d-746e-462b-81d2-b02f316ac99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740ab62d-746e-462b-81d2-b02f316ac99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98f440f-e8f6-4009-a6b2-dfbc13074ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:34:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4ffac025-b108-4b31-8e7a-65c9735bf7c3 tempest-CreateVolumesFromImageTest-601090492 None] Created volume successfully. Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (c378f9b3-88c2-414a-9a53-dabf87fe605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9780cdab-6fb1-49a6-8475-1b2c9e3aa0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9780cdab-6fb1-49a6-8475-1b2c9e3aa0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115655510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731a2e94-3c20-46be-a471-8bdafb778818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:33Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd183d1d-b083-4db1-be7e-c8c07093264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd183d1d-b083-4db1-be7e-c8c07093264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a20235-7d69-4d04-b573-78832f3760f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a20235-7d69-4d04-b573-78832f3760f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731a2e94-3c20-46be-a471-8bdafb778818', 'volume_name': 'volume-731a2e94-3c20-46be-a471-8bdafb778818', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2659a-bccb-4ce1-a35f-27b81fe6c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc2659a-bccb-4ce1-a35f-27b81fe6c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7295a36b-5d13-4d0c-b511-73fb608a27e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume 731a2e94-3c20-46be-a471-8bdafb778818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731a2e94-3c20-46be-a471-8bdafb778818', 'volume_size': 1} Sep 01 00:34:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98f440f-e8f6-4009-a6b2-dfbc13074ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ea73b81-9afa-4f8b-bc34-00462d7df513', 'volume_name': 'volume-9ea73b81-9afa-4f8b-bc34-00462d7df513', 'volume_size': 1, 'image_id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '006acbb35bdb19eb7c065c7859210d1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ec61faacd0b4a779d38bb1b38870222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b370eee445b8d8d44e7395e5c5fdf33f4bacbc00d30839fe9021a482af606d516b19a4d2490e1b1760343720efeef36fd6e1c70b565ebac9c026daf181e41ae', 'id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a53643db-545f-42c1-8faa-f6452be3645c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81127389-c78c-4174-90c9-59723f4082e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81127389-c78c-4174-90c9-59723f4082e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50158828-755d-4643-8da1-7db9789f7d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Volume 9ea73b81-9afa-4f8b-bc34-00462d7df513: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ea73b81-9afa-4f8b-bc34-00462d7df513', 'volume_size': 1, 'image_id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '006acbb35bdb19eb7c065c7859210d1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ec61faacd0b4a779d38bb1b38870222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b370eee445b8d8d44e7395e5c5fdf33f4bacbc00d30839fe9021a482af606d516b19a4d2490e1b1760343720efeef36fd6e1c70b565ebac9c026daf181e41ae', 'id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a53643db-545f-42c1-8faa-f6452be3645c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Trying to clone 9ea73b81-9afa-4f8b-bc34-00462d7df513 from image a53643db-545f-42c1-8faa-f6452be3645c at location (None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:34:33 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 1073741824" returned: 0 in 0.501s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:33 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 Sep 01 00:34:33 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:34:33 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Image download 0.00 MB at 0.00 MB/s Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0e394-7abb-4f42-b87e-da91445c854a]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:33 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:33 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:33 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.530s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating offline snapshot 45610c36-20df-4f20-8df2-5a09a0328587 of volume 651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dd5672-91ef-4d30-b6f0-fb2b8794b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3470e70f-dcd6-40f8-a686-e3d21f41284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003af0e-c058-4e8c-9882-1355b24041c0]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Volume volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 (35e911b8-40ae-4e1d-8c2f-63642a1630a2): created successfully Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3470e70f-dcd6-40f8-a686-e3d21f41284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (d861c9c7-62cf-467f-863b-e059f7e2c661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-877473ab-3d77-4a41-a027-0fe943968cf3 tempest-CreateVolumesFromImageTest-601090492 None] Created volume successfully. Sep 01 00:34:33 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:33 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a Sep 01 00:34:33 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:33 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:33 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 1G Sep 01 00:34:33 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:33 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Temporary image a53643db-545f-42c1-8faa-f6452be3645c is fetched for user 19d56d9e0a4645beac2e710f78d65db3. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e0fa09-2a95-4c8e-8fa7-3795dacbcee2]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:34 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:34 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:34 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 1G" returned: 0 in 0.462s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d41c4-8d50-4b16-a51f-e85cde66013a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:34 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d41c4-8d50-4b16-a51f-e85cde66013a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 Sep 01 00:34:34 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:34 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:34 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:34 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:34 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d41c4-8d50-4b16-a51f-e85cde66013a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:34 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 is being set with open permissions: ugo+rw Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:34 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 Sep 01 00:34:34 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:34 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:34 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587" returned: 0 in 0.258s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:35 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info Sep 01 00:34:35 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:35 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info" returned: 0 in 0.265s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:35 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info is being set with open permissions: ugo+rw Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:35 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info Sep 01 00:34:35 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:35 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.info" returned: 0 in 0.245s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191697401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aede659-bb51-4ff0-834d-b029b5d3fca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5af8c8a37644409da829e440dc38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:30Z,use_quota=True,user_id='ba8ef656668146389476bd0bce755076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Creating volume 7aede659-bb51-4ff0-834d-b029b5d3fca4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:35 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 1073741824 Sep 01 00:34:35 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a0757709-b95e-4b57-a44e-4fb02b05ba84 tempest-CreateVolumesFromSnapshotTest-880551373 None] Create snapshot completed successfully Sep 01 00:34:35 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 1073741824" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:36 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 Sep 01 00:34:36 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:36 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.250s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143382247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6330594f-3f83-40ed-8a2d-f8994452efe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:31Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 6330594f-3f83-40ed-8a2d-f8994452efe9 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:36 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a69515-4a06-45d4-bc6b-cf86cb1467c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aede659-bb51-4ff0-834d-b029b5d3fca4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:36 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 1073741824 Sep 01 00:34:36 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a315cff-a588-47a6-b85c-942d68fc06c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Volume volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 (7aede659-bb51-4ff0-834d-b029b5d3fca4): created successfully Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a315cff-a588-47a6-b85c-942d68fc06c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Flow 'volume_create_manager' (b2d0cec7-4fd9-4d4e-8b85-43883e24dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7fa94c18-7554-4f03-8228-734e10db01aa tempest-CreateVolumesFromImageTest-601090492 None] Created volume successfully. Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-7aede659-bb51-4ff0-834d-b029b5d3fca4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:36 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-7aede659-bb51-4ff0-834d-b029b5d3fca4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 1073741824" returned: 0 in 0.585s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (e133ad4d-8529-4bda-b135-41381d50f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ab89fd-5a02-4488-8ed8-312bd597d6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ab89fd-5a02-4488-8ed8-312bd597d6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441043159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c24b64-ba89-4718-8e9b-58f9c75e489e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:37Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c13318-f353-4012-a06a-19115176c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c13318-f353-4012-a06a-19115176c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69548bd1-251a-47d6-bb92-ba0901ddc908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69548bd1-251a-47d6-bb92-ba0901ddc908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c24b64-ba89-4718-8e9b-58f9c75e489e', 'volume_name': 'volume-32c24b64-ba89-4718-8e9b-58f9c75e489e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53738204-ad25-45b3-aad2-f82f79ab7ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53738204-ad25-45b3-aad2-f82f79ab7ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32031be3-4f8d-44fd-af4a-891e9280631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume 32c24b64-ba89-4718-8e9b-58f9c75e489e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c24b64-ba89-4718-8e9b-58f9c75e489e', 'volume_size': 1} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-quobyte-7aede659-bb51-4ff0-834d-b029b5d3fca4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-7aede659-bb51-4ff0-834d-b029b5d3fca4" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:37 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 Sep 01 00:34:37 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3efa33-e022-45f8-89e2-ab719d7ac674]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:37 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 Sep 01 00:34:37 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (21c477eb-3848-4f72-9170-a4619cd2fba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc28e4b-7f5c-472f-a153-f3ef6acacf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc28e4b-7f5c-472f-a153-f3ef6acacf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841419432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afd9c4e-68fd-43cf-b18d-51a6196ed47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:37Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc66a6c-3d22-4ec7-ba42-bf00fe9980d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc66a6c-3d22-4ec7-ba42-bf00fe9980d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ab140b-5dae-4d14-92de-8ecb17096cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ab140b-5dae-4d14-92de-8ecb17096cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afd9c4e-68fd-43cf-b18d-51a6196ed47f', 'volume_name': 'volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae200b73-ccfe-44d2-8799-9dee6836f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae200b73-ccfe-44d2-8799-9dee6836f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6ebc3d-ba7a-4e09-85d0-65650bb5b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume 6afd9c4e-68fd-43cf-b18d-51a6196ed47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f', 'volume_size': 1} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:37 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9" returned: 0 in 0.354s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.959s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884222760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513986fc-3028-44f9-9cc2-119d6a9591e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:31Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 513986fc-3028-44f9-9cc2-119d6a9591e7 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b209ff70-2357-4e5b-b07e-726981bbc9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6330594f-3f83-40ed-8a2d-f8994452efe9', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f6afc9-1ab4-47cb-a0d0-bcdb1dae4ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 1073741824 Sep 01 00:34:37 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-6330594f-3f83-40ed-8a2d-f8994452efe9 (6330594f-3f83-40ed-8a2d-f8994452efe9): created successfully Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f6afc9-1ab4-47cb-a0d0-bcdb1dae4ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (c41eecb8-a23c-4654-ae82-dc68bb99af4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-842ee8f3-2594-4ce4-bfe2-faf614667941 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:37 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4" returned: 0 in 0.458s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:37 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4 Sep 01 00:34:37 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (4131fc8c-c637-40c9-bb9b-68469d3bcd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff297a93-863b-49ac-9eb5-b4798aa1e236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff297a93-863b-49ac-9eb5-b4798aa1e236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005238656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8690e9ee-0dc9-42c5-ba45-893d382e15e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:38Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253a97ba-8a6f-4eb1-92d9-82d7649720cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253a97ba-8a6f-4eb1-92d9-82d7649720cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ece26bc-0dc6-4999-8c6a-36e7fda7bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ece26bc-0dc6-4999-8c6a-36e7fda7bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8690e9ee-0dc9-42c5-ba45-893d382e15e5', 'volume_name': 'volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e96149-887d-43c0-84a0-c2ecbf94f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e96149-887d-43c0-84a0-c2ecbf94f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a95966-0863-40de-b3c4-4fa54880d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:37 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume 8690e9ee-0dc9-42c5-ba45-893d382e15e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5', 'volume_size': 1} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:37 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7aede659-bb51-4ff0-834d-b029b5d3fca4" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-7aede659-bb51-4ff0-834d-b029b5d3fca4" released by "delete_volume" :: held 0.897s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Created reservations ['d1b0ed96-fba6-40a3-8f11-c0810d58448c', '474ff4df-4fbd-4291-9c8b-adf2da30d265', 'e008c945-22d6-46fd-bfe6-60f2f326a836', '2a3c4e4a-d8ba-49f9-81fb-e16c35dc01a8'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:38 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 1073741824" returned: 0 in 0.683s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:38 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 Sep 01 00:34:38 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:38 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:38 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (537a7e40-9a32-4e71-a4d9-88c2857d405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da35cee1-5576-4905-b152-0bd91f96481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da35cee1-5576-4905-b152-0bd91f96481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1258466850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc107989-f1e6-4cc8-b3a6-6752a7d88436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:38Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f961bee4-74d1-4ce6-beef-abd386d9c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f961bee4-74d1-4ce6-beef-abd386d9c057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147f056f-0ac4-4de3-8fa5-a85b52ed6948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147f056f-0ac4-4de3-8fa5-a85b52ed6948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc107989-f1e6-4cc8-b3a6-6752a7d88436', 'volume_name': 'volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f71274-97f0-49ba-8c2a-f4ecc503232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f71274-97f0-49ba-8c2a-f4ecc503232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6658637-2386-45e4-822c-14bdefd8a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume bc107989-f1e6-4cc8-b3a6-6752a7d88436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436', 'volume_size': 1} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:38 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.322s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:38 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Deleted volume successfully. Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.593s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2100513445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585cd619-a533-445f-acb5-045ac3eabf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:32Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 585cd619-a533-445f-acb5-045ac3eabf16 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ab3938-47dc-49df-b6a9-f062c748825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513986fc-3028-44f9-9cc2-119d6a9591e7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 1073741824 Sep 01 00:34:38 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd211c3-c1d6-46f0-9ab9-2cbbdaf6d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0b22a138-8607-41e5-b837-d542f7026637 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-7aede659-bb51-4ff0-834d-b029b5d3fca4-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-513986fc-3028-44f9-9cc2-119d6a9591e7 (513986fc-3028-44f9-9cc2-119d6a9591e7): created successfully Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd211c3-c1d6-46f0-9ab9-2cbbdaf6d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (d2b7bc4e-dfe4-4f73-9cee-be242c1fa7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-25c2feef-bdf0-4380-aae8-257fc2bc28b9 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (13e319a2-02a1-4393-a47b-ccf80cef7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4af7928-c5d9-483e-85b4-f9773e2d5893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4af7928-c5d9-483e-85b4-f9773e2d5893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862039658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2385884d-501a-4444-acd3-cd5f0e671d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:39Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03680197-9fd9-41a4-9b9a-bfc63bada111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03680197-9fd9-41a4-9b9a-bfc63bada111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a2192-1db1-4102-8bc2-f0223e07bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7a2192-1db1-4102-8bc2-f0223e07bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2385884d-501a-4444-acd3-cd5f0e671d3a', 'volume_name': 'volume-2385884d-501a-4444-acd3-cd5f0e671d3a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4b0903-6a2b-4403-bef7-9354ccc36e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4b0903-6a2b-4403-bef7-9354ccc36e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af51e7c2-7c14-425c-9a0a-e865c034d7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:38 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume 2385884d-501a-4444-acd3-cd5f0e671d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2385884d-501a-4444-acd3-cd5f0e671d3a', 'volume_size': 1} Sep 01 00:34:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:39 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 1073741824" returned: 0 in 0.457s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:39 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 Sep 01 00:34:39 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-35e911b8-40ae-4e1d-8c2f-63642a1630a2-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-35e911b8-40ae-4e1d-8c2f-63642a1630a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-quobyte-35e911b8-40ae-4e1d-8c2f-63642a1630a2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-35e911b8-40ae-4e1d-8c2f-63642a1630a2" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:39 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca2109-0a9c-477e-8521-e71a0c3df021]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.689s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-960883342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62386a31-18a8-4f38-9ff7-769e187bab5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:32Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 62386a31-18a8-4f38-9ff7-769e187bab5d {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:39 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:39 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d 1073741824 Sep 01 00:34:39 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033f498c-499a-41f4-970a-c129c2529b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585cd619-a533-445f-acb5-045ac3eabf16', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0d0c5-fdad-4939-a8a8-980e025aec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-585cd619-a533-445f-acb5-045ac3eabf16 (585cd619-a533-445f-acb5-045ac3eabf16): created successfully Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0d0c5-fdad-4939-a8a8-980e025aec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (ebbb7949-b4d7-45dc-8e43-1471fe3a7366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-913bd2b4-f6ee-418f-bb35-f97802584bf7 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:39 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 Sep 01 00:34:39 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:39 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2" returned: 0 in 0.417s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:39 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d 1073741824" returned: 0 in 0.461s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:39 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2 Sep 01 00:34:39 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:39 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d Sep 01 00:34:39 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:40 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-35e911b8-40ae-4e1d-8c2f-63642a1630a2" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-35e911b8-40ae-4e1d-8c2f-63642a1630a2" released by "delete_volume" :: held 0.754s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Created reservations ['68554301-5322-4382-be2a-0706c29fb027', '58adfe97-3d70-47fd-bfcd-da071b19feda', '97aba1b1-9360-42c3-9aec-e31b02bca72e', 'a788600a-7a47-4d1f-9cdc-7d67bdab0d31'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:40 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.246s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115655510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731a2e94-3c20-46be-a471-8bdafb778818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c0dd83cd6247e0b3cb1df78939ea33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:33Z,use_quota=True,user_id='8e2581c57d10440ab593bddef1cbd30c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Creating volume 731a2e94-3c20-46be-a471-8bdafb778818 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:40 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:40 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 1073741824 Sep 01 00:34:40 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa9ffe6-3fa7-4898-8fdf-5c599df1086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62386a31-18a8-4f38-9ff7-769e187bab5d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c6f668-31ea-4605-b2f1-dcc44a2e9bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:40 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-62386a31-18a8-4f38-9ff7-769e187bab5d (62386a31-18a8-4f38-9ff7-769e187bab5d): created successfully Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c6f668-31ea-4605-b2f1-dcc44a2e9bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (5447d9aa-5aaa-4d94-82b4-9bcce18277b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-87a790d2-a40f-45f2-baaa-41910d6c3ac2 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:40 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:40 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-quobyte-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:40 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.304s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Deleted volume successfully. Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb750f-7882-4e10-91b2-b1b188ff60ef]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb9d3463-b8db-47bd-94f9-141e220ae343 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-35e911b8-40ae-4e1d-8c2f-63642a1630a2-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:40 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 Sep 01 00:34:40 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:40 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 1073741824" returned: 0 in 0.596s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:40 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 Sep 01 00:34:40 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:41 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" returned: 0 in 0.421s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:41 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9 Sep 01 00:34:41 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:41 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818" returned: 0 in 0.278s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.336s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea73b81-9afa-4f8b-bc34-00462d7df513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec61faacd0b4a779d38bb1b38870222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:33Z,use_quota=True,user_id='19d56d9e0a4645beac2e710f78d65db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75d682c-f21a-49bd-80e9-7ce67a7b760e),volume_type_id=f75d682c-f21a-49bd-80e9-7ce67a7b760e)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Creating volume 9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7295a36b-5d13-4d0c-b511-73fb608a27e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731a2e94-3c20-46be-a471-8bdafb778818', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:41 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1073741824 Sep 01 00:34:41 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0dcb5-1cbd-4d8f-a497-b8862b8dfc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Volume volume-731a2e94-3c20-46be-a471-8bdafb778818 (731a2e94-3c20-46be-a471-8bdafb778818): created successfully Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0dcb5-1cbd-4d8f-a497-b8862b8dfc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Flow 'volume_create_manager' (c378f9b3-88c2-414a-9a53-dabf87fe605f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a4cf063b-97d7-4ea3-ab3c-b9c1f4653555 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created volume successfully. Sep 01 00:34:41 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9" released by "delete_volume" :: held 0.755s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Created reservations ['53284816-2a7a-4b2f-b9ea-bdcc00c8482b', 'cbcb49e1-d674-45e8-ba29-b48493d0c511', 'b8e8c3db-ba26-4087-804e-2aa156206fcd', '2dab9f93-0f5b-4c3a-bada-a49f55c1656e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:41 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:41 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:41 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1073741824" returned: 0 in 0.484s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:41 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 Sep 01 00:34:41 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-85ee563d-655b-480a-b053-dea1a6660541-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-85ee563d-655b-480a-b053-dea1a6660541-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-quobyte-85ee563d-655b-480a-b053-dea1a6660541" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-85ee563d-655b-480a-b053-dea1a6660541" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-731a2e94-3c20-46be-a471-8bdafb778818-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-731a2e94-3c20-46be-a471-8bdafb778818-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ab103-8c0b-4c54-971b-867a3b93be13]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.440s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-731a2e94-3c20-46be-a471-8bdafb778818" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Deleted volume successfully. Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-731a2e94-3c20-46be-a471-8bdafb778818" acquired by "delete_volume" :: waited 0.040s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f0e59fcc-45a4-44ba-9855-0fee8440ea86 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-360b2ad9-23f0-4d75-bfe5-cfd83a4d7be9-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe9bee2-1876-42a0-937f-2f8bc191bbe6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 Sep 01 00:34:42 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513" returned: 0 in 0.407s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.092s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441043159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c24b64-ba89-4718-8e9b-58f9c75e489e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:37Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume 32c24b64-ba89-4718-8e9b-58f9c75e489e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:42 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e 1073741824 Sep 01 00:34:42 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Attempting download of a53643db-545f-42c1-8faa-f6452be3645c ((None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}])) to volume 9ea73b81-9afa-4f8b-bc34-00462d7df513. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:34:42 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 Sep 01 00:34:42 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228d36b-4955-4332-8e6b-8a46069c3b49]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z Sep 01 00:34:42 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541" returned: 0 in 0.466s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541 Sep 01 00:34:42 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818" returned: 0 in 0.495s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818 Sep 01 00:34:42 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z" returned: 0 in 0.384s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e 1073741824" returned: 0 in 0.529s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85ee563d-655b-480a-b053-dea1a6660541" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-85ee563d-655b-480a-b053-dea1a6660541" released by "delete_volume" :: held 0.842s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:42 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e Sep 01 00:34:42 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z Sep 01 00:34:42 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Created reservations ['9e5efb24-785b-4ebc-aae6-7ae2d3f80fd2', 'db1731ad-9ad0-44a7-9009-891a5a418b92', '3b93e9e1-a50c-4ddf-81ce-b6770db627aa', '8ce21819-0959-42db-9764-cb9fdead49a1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:42 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-731a2e94-3c20-46be-a471-8bdafb778818" returned: 0 in 0.327s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-731a2e94-3c20-46be-a471-8bdafb778818" released by "delete_volume" :: held 0.882s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:42 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:42 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['2f5e26c6-3325-47a7-954d-32373a0df981', '51af1a50-690e-4ad9-b00e-df4f5d2e3a3b', '34a40a15-5332-46eb-9404-6e17af1a5d3b', '546d9523-da89-4025-a703-9737aa0ed2a4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:43 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z" returned: 1 in 0.424s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a53643db-545f-42c1-8faa-f6452be3645c_y4d1h74z' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:43 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463139e-e42e-4810-9c22-3373d7388695]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e" returned: 0 in 0.391s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.723s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841419432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afd9c4e-68fd-43cf-b18d-51a6196ed47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:37Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume 6afd9c4e-68fd-43cf-b18d-51a6196ed47f {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:43 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-c8a98a33-35ac-4062-b4ab-4592fdf994d9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:43 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f 1073741824 Sep 01 00:34:43 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32031be3-4f8d-44fd-af4a-891e9280631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c24b64-ba89-4718-8e9b-58f9c75e489e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4d5eb6-f7c0-4ee3-bcd7-d3f124957a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-c8a98a33-35ac-4062-b4ab-4592fdf994d9-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:43 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-32c24b64-ba89-4718-8e9b-58f9c75e489e (32c24b64-ba89-4718-8e9b-58f9c75e489e): created successfully Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4d5eb6-f7c0-4ee3-bcd7-d3f124957a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (e133ad4d-8529-4bda-b135-41381d50f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-62386a31-18a8-4f38-9ff7-769e187bab5d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-acd6286b-5cb5-45ac-8e47-1eb8cd3fa59a tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:43 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:43 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-62386a31-18a8-4f38-9ff7-769e187bab5d-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "cinder-quobyte-c8a98a33-35ac-4062-b4ab-4592fdf994d9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:43 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-c8a98a33-35ac-4062-b4ab-4592fdf994d9" acquired by "delete_volume" :: waited 0.038s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.589s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77df398-e948-4eb8-bfc6-714f42f05c43]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-62386a31-18a8-4f38-9ff7-769e187bab5d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Deleted volume successfully. Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-62386a31-18a8-4f38-9ff7-769e187bab5d" acquired by "delete_volume" :: waited 0.057s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fc675a39-fbee-4505-b5e4-c0e229c6c0ce tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-85ee563d-655b-480a-b053-dea1a6660541-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa88944f-0888-46ea-b8f7-1f0e84ce93ed]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 0 in 0.582s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:43 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 Sep 01 00:34:43 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-5213ee1b-ffe1-4a54-8cf1-1ca73feb7246 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-731a2e94-3c20-46be-a471-8bdafb778818-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:43 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d Sep 01 00:34:43 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f 1073741824" returned: 0 in 0.656s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:43 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD Sep 01 00:34:43 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:43 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f Sep 01 00:34:43 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9" returned: 0 in 0.508s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d" returned: 0 in 0.457s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9 Sep 01 00:34:44 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d Sep 01 00:34:44 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" returned: 0 in 0.303s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.272s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005238656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8690e9ee-0dc9-42c5-ba45-893d382e15e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:38Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume 8690e9ee-0dc9-42c5-ba45-893d382e15e5 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:44 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:44 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] a53643db-545f-42c1-8faa-f6452be3645c was raw, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 1073741824 Sep 01 00:34:44 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6ebc3d-ba7a-4e09-85d0-65650bb5b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97663fc-57e8-4fae-920b-6dd49226c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:44 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 Sep 01 00:34:44 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f (6afd9c4e-68fd-43cf-b18d-51a6196ed47f): created successfully Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97663fc-57e8-4fae-920b-6dd49226c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (21c477eb-3848-4f72-9170-a4619cd2fba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0db6b68e-4854-4760-917a-88f98681ba09 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:44 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c8a98a33-35ac-4062-b4ab-4592fdf994d9" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-quobyte-c8a98a33-35ac-4062-b4ab-4592fdf994d9" released by "delete_volume" :: held 0.950s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:44 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-62386a31-18a8-4f38-9ff7-769e187bab5d" returned: 0 in 0.382s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-62386a31-18a8-4f38-9ff7-769e187bab5d" released by "delete_volume" :: held 0.910s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Created reservations ['f207ce61-99f4-4984-9b57-8c96332171e3', '2c58a269-e140-46c1-817b-8a0757f040c9', 'ea24b72b-9f7b-4f54-8bf1-24ba54d66011', '1d6a9cec-c9ac-422a-b724-c258613f495f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['1fa775f0-4564-4249-a571-5d72dad06d98', '4fe0d037-552f-4904-8508-ac70df1042cf', 'f70438ab-7077-455d-8449-6a31891f6417', 'f6a7a12e-b9d5-4ae4-8a6c-409d64070511'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 1073741824" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:44 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513" returned: 0 in 0.629s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a53643db-545f-42c1-8faa-f6452be3645c_xi_nqsg9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:34:44 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1G Sep 01 00:34:44 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:44 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.290s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:45 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:45 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Deleted volume successfully. Sep 01 00:34:45 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 Sep 01 00:34:45 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-865d2e4d-5196-4ca7-ba97-7a04f20a3b52 tempest-CreateVolumesFromImageTest-601090492 None] Lock "cinder-c8a98a33-35ac-4062-b4ab-4592fdf994d9-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:45 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 1G" returned: 0 in 0.336s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Downloaded image a53643db-545f-42c1-8faa-f6452be3645c ((None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}])) to volume 9ea73b81-9afa-4f8b-bc34-00462d7df513 successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Temporary image a53643db-545f-42c1-8faa-f6452be3645c for user 19d56d9e0a4645beac2e710f78d65db3 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Marking volume 9ea73b81-9afa-4f8b-bc34-00462d7df513 as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Copying metadata from image a53643db-545f-42c1-8faa-f6452be3645c to 9ea73b81-9afa-4f8b-bc34-00462d7df513. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Creating volume glance metadata for volume 9ea73b81-9afa-4f8b-bc34-00462d7df513 backed by image a53643db-545f-42c1-8faa-f6452be3645c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '006acbb35bdb19eb7c065c7859210d1e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:34:45 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.295s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50158828-755d-4643-8da1-7db9789f7d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea73b81-9afa-4f8b-bc34-00462d7df513', 'volume_size': 1, 'image_id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a53643db-545f-42c1-8faa-f6452be3645c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '006acbb35bdb19eb7c065c7859210d1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ec61faacd0b4a779d38bb1b38870222', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b370eee445b8d8d44e7395e5c5fdf33f4bacbc00d30839fe9021a482af606d516b19a4d2490e1b1760343720efeef36fd6e1c70b565ebac9c026daf181e41ae', 'id': 'a53643db-545f-42c1-8faa-f6452be3645c', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a53643db-545f-42c1-8faa-f6452be3645c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0284028-9c31-4c22-95f8-bf8ef6920588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1c6ed232-dd59-446b-9099-1e13f52e9c3a tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-62386a31-18a8-4f38-9ff7-769e187bab5d-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Volume volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 (9ea73b81-9afa-4f8b-bc34-00462d7df513): created successfully Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0284028-9c31-4c22-95f8-bf8ef6920588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Flow 'volume_create_manager' (af981407-0053-4295-8b79-4676df2ff142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:45 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8a6fc28f-7887-4380-8c18-acea6c4802f2 tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Created volume successfully. Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.957s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1258466850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc107989-f1e6-4cc8-b3a6-6752a7d88436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:38Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume bc107989-f1e6-4cc8-b3a6-6752a7d88436 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a95966-0863-40de-b3c4-4fa54880d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:45 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 1073741824 Sep 01 00:34:45 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8a157d-ea29-4e3e-b6c5-2bfb3c50bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 (8690e9ee-0dc9-42c5-ba45-893d382e15e5): created successfully Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8a157d-ea29-4e3e-b6c5-2bfb3c50bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (4131fc8c-c637-40c9-bb9b-68469d3bcd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:45 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-78a6e09b-78a3-412f-b868-9a703466fb21 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Acquiring lock "cinder-9ea73b81-9afa-4f8b-bc34-00462d7df513-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-585cd619-a533-445f-acb5-045ac3eabf16-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "cinder-9ea73b81-9afa-4f8b-bc34-00462d7df513-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-585cd619-a533-445f-acb5-045ac3eabf16-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Acquiring lock "cinder-quobyte-9ea73b81-9afa-4f8b-bc34-00462d7df513" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-585cd619-a533-445f-acb5-045ac3eabf16" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "cinder-quobyte-9ea73b81-9afa-4f8b-bc34-00462d7df513" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-585cd619-a533-445f-acb5-045ac3eabf16" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c156326-11be-4283-a5bf-58d862c8fb69]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86cb48e-7caa-45f8-b285-f62839cc9bee]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:45 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 1073741824" returned: 0 in 0.593s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 Sep 01 00:34:46 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 Sep 01 00:34:46 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:46 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 Sep 01 00:34:46 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:46 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513" returned: 0 in 0.478s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16" returned: 0 in 0.491s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:46 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436" returned: 0 in 0.379s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16 Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:46 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513 Sep 01 00:34:46 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.636s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862039658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2385884d-501a-4444-acd3-cd5f0e671d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309dacdbf96f49e1a450ba08d2a7a423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:39Z,use_quota=True,user_id='056ffafb5fc5404c8b2df121aca0909d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Creating volume 2385884d-501a-4444-acd3-cd5f0e671d3a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:46 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:46 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a 1073741824 Sep 01 00:34:46 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6658637-2386-45e4-822c-14bdefd8a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d57ea-349b-461e-bcfa-4f6090ddc133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:46 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 (bc107989-f1e6-4cc8-b3a6-6752a7d88436): created successfully Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d57ea-349b-461e-bcfa-4f6090ddc133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (537a7e40-9a32-4e71-a4d9-88c2857d405b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1a04940b-b503-445e-941f-3d9449214f47 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:46 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-9ea73b81-9afa-4f8b-bc34-00462d7df513" returned: 0 in 0.441s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "cinder-quobyte-9ea73b81-9afa-4f8b-bc34-00462d7df513" released by "delete_volume" :: held 0.988s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:46 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-585cd619-a533-445f-acb5-045ac3eabf16" returned: 0 in 0.463s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-585cd619-a533-445f-acb5-045ac3eabf16" released by "delete_volume" :: held 1.021s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Created reservations ['f6e9df38-2dd0-4f16-b0bf-5de4acb3ff32', '4464e330-d153-4bc7-8aaa-7c024ae93101', '692c5620-0550-4f4e-8c8d-0e93098b5eb4', '77eaadb9-025d-445f-943d-5767ca267899'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['a86d2cb8-0c42-4966-896c-f275a63ac471', 'd26d0efa-b8f6-4eaa-a263-bff5a356db24', 'a9f1e78f-10c1-464f-9e21-f5e8cbe93ce8', 'a672fd12-d08d-46d5-afb6-4fc7fe22ca5e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:47 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:47 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:47 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:47 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:47 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a 1073741824" returned: 0 in 0.756s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:47 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a Sep 01 00:34:47 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:47 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Deleted volume successfully. Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-f50e2c05-6cbf-4bed-b527-f0dc2b490b7a tempest-VolumeAndVolumeTypeFromImageTest-1213943512 None] Lock "cinder-9ea73b81-9afa-4f8b-bc34-00462d7df513-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:47 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.359s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1994dafe-80d6-4e71-895d-bf3a704aa804 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-585cd619-a533-445f-acb5-045ac3eabf16-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:47 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a" returned: 0 in 0.346s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af51e7c2-7c14-425c-9a0a-e865c034d7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2385884d-501a-4444-acd3-cd5f0e671d3a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c3a57-e24b-49e6-b9d0-811961df65e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:47 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Volume volume-2385884d-501a-4444-acd3-cd5f0e671d3a (2385884d-501a-4444-acd3-cd5f0e671d3a): created successfully Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3c3a57-e24b-49e6-b9d0-811961df65e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Flow 'volume_create_manager' (13e319a2-02a1-4393-a47b-ccf80cef7487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-63c71095-7ae9-4e32-9c4c-556d3ee2f3a6 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created volume successfully. Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-2385884d-501a-4444-acd3-cd5f0e671d3a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-2385884d-501a-4444-acd3-cd5f0e671d3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-2385884d-501a-4444-acd3-cd5f0e671d3a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-2385884d-501a-4444-acd3-cd5f0e671d3a" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[30755c7b-bae1-4a93-bbcb-551dbd27447d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-513986fc-3028-44f9-9cc2-119d6a9591e7-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-513986fc-3028-44f9-9cc2-119d6a9591e7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:48 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a Sep 01 00:34:48 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-513986fc-3028-44f9-9cc2-119d6a9591e7" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-513986fc-3028-44f9-9cc2-119d6a9591e7" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacc0e9d-e598-4c19-8088-2510b7d2859c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:48 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 Sep 01 00:34:48 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:48 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a" returned: 0 in 0.527s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:48 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a Sep 01 00:34:48 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:48 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7" returned: 0 in 0.505s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:48 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7 Sep 01 00:34:48 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:48 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-2385884d-501a-4444-acd3-cd5f0e671d3a" returned: 0 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-2385884d-501a-4444-acd3-cd5f0e671d3a" released by "delete_volume" :: held 0.911s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:48 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['8feed4c6-4398-4c0e-bdb0-fbdc5a22b926', '51a4fc77-93ac-411f-9593-e0fa940a57a1', '3397a675-02ba-4e36-b683-4754785485bc', 'c516300d-0533-4d8f-88c0-eaebfb0756bb'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:49 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-513986fc-3028-44f9-9cc2-119d6a9591e7" returned: 0 in 0.344s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:49 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-513986fc-3028-44f9-9cc2-119d6a9591e7" released by "delete_volume" :: held 0.913s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:49 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-bc107989-f1e6-4cc8-b3a6-6752a7d88436-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['638b26b3-5da1-49ca-ba86-194c048afe5a', '2a3ca9c7-a6c0-49ee-a7cd-c28fbb05aa11', '0b35f0e2-3f92-4b72-b1bc-4bad0f5e9e14', '11a16f97-ed62-48e2-a219-8bad5599d88d'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-bc107989-f1e6-4cc8-b3a6-6752a7d88436-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-bc107989-f1e6-4cc8-b3a6-6752a7d88436" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-bc107989-f1e6-4cc8-b3a6-6752a7d88436" acquired by "delete_volume" :: waited 0.058s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1252f-21b2-4909-bc17-b721e25b6fcd]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:49 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:49 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:49 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.473s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:34:49 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 Sep 01 00:34:49 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-c2ac3c2f-3577-4151-96e5-d0c03f6d5f7c tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-2385884d-501a-4444-acd3-cd5f0e671d3a-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:49 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.306s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-93f942ad-5016-4e5c-8d2a-0a05c3d9d97c tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-513986fc-3028-44f9-9cc2-119d6a9591e7-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:49 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436" returned: 0 in 0.524s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:49 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436 Sep 01 00:34:49 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Flow 'volume_create_manager' (37fbcf63-5a34-4f2e-8bd1-56dbb111aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0aca38-5f85-48f4-a218-d7605e67966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0aca38-5f85-48f4-a218-d7605e67966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1657806094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f258c-74a9-4c05-8cc7-76843202d0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23e6d9c4e9042828f4164f7f52d3fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:50Z,use_quota=True,user_id='3f8b3c269cdd46f289d37e6a04df5d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf552be-d494-4264-974c-0231917a7c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf552be-d494-4264-974c-0231917a7c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:50 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7750382-206a-43c8-ae15-c2f1f970204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7750382-206a-43c8-ae15-c2f1f970204f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2f258c-74a9-4c05-8cc7-76843202d0f8', 'volume_name': 'volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a055d9d-0b8a-43b3-88ff-a28520ad3332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a055d9d-0b8a-43b3-88ff-a28520ad3332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c5ba65-c43c-4a14-8716-65c723649421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:50 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Volume ac2f258c-74a9-4c05-8cc7-76843202d0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8', 'volume_size': 1} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1657806094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f258c-74a9-4c05-8cc7-76843202d0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23e6d9c4e9042828f4164f7f52d3fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:50Z,use_quota=True,user_id='3f8b3c269cdd46f289d37e6a04df5d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Creating volume ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:50 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bc107989-f1e6-4cc8-b3a6-6752a7d88436" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:50 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 1073741824 Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-bc107989-f1e6-4cc8-b3a6-6752a7d88436" released by "delete_volume" :: held 0.970s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:50 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['979006e2-8dd6-42c7-80d1-e71573281d2b', '3888226c-afb3-435d-bce8-28cceda3fc6e', '230d8a8d-6ee5-48fa-bd3c-ac798ed12684', 'd88e3d31-18fe-4674-8d5a-72e884a65909'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-6330594f-3f83-40ed-8a2d-f8994452efe9-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-6330594f-3f83-40ed-8a2d-f8994452efe9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-6330594f-3f83-40ed-8a2d-f8994452efe9" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-6330594f-3f83-40ed-8a2d-f8994452efe9" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a99c4-1cc6-49d0-a322-94a22757d7c9]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 1073741824" returned: 0 in 0.631s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:51 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:34:51 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:51 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 Sep 01 00:34:51 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:51 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-394786cc-edb4-439e-b7b1-1e8f5758048b tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-bc107989-f1e6-4cc8-b3a6-6752a7d88436-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:51 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c5ba65-c43c-4a14-8716-65c723649421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bc6641-139d-415e-af57-b4cd6163497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:51 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9" returned: 0 in 0.534s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:51 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9 Sep 01 00:34:51 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:51 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Volume volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 (ac2f258c-74a9-4c05-8cc7-76843202d0f8): created successfully Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94bc6641-139d-415e-af57-b4cd6163497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Flow 'volume_create_manager' (37fbcf63-5a34-4f2e-8bd1-56dbb111aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-8690e9ee-0dc9-42c5-ba45-893d382e15e5-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-af01816e-e428-4a26-8a28-3eadc456d1c0 tempest-VolumeDependencyTests-1187896408 None] Created volume successfully. Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-8690e9ee-0dc9-42c5-ba45-893d382e15e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:51 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6330594f-3f83-40ed-8a2d-f8994452efe9" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-8690e9ee-0dc9-42c5-ba45-893d382e15e5" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-6330594f-3f83-40ed-8a2d-f8994452efe9" released by "delete_volume" :: held 0.875s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-8690e9ee-0dc9-42c5-ba45-893d382e15e5" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3499ff-0d64-40b7-9ddf-400f0ea490fd]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['486b41e9-7a71-40a2-8c4e-2d87646b2e7f', '130e74c7-4092-4e62-8f62-1cb878ad3f61', '0aab678d-1f33-4d75-b3b2-c5d3f1469940', '8fb9337b-1062-4add-a8ef-2ad9ccc2e4e5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:51 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 Sep 01 00:34:51 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:51 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:51 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:52 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.273s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:52 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5" returned: 0 in 0.461s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7c8b3234-35f9-4307-9c49-26183739e005 tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-6330594f-3f83-40ed-8a2d-f8994452efe9-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:52 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5 Sep 01 00:34:52 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:52 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8690e9ee-0dc9-42c5-ba45-893d382e15e5" returned: 0 in 0.349s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-8690e9ee-0dc9-42c5-ba45-893d382e15e5" released by "delete_volume" :: held 0.871s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Creating offline snapshot 8ffcd36f-1ec1-4ae6-ab15-9395320305b5 of volume ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e37ab86-e5bc-41b2-afa7-8507a48526ca]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['913e00ea-eb06-4d67-85a2-b6cf69959e07', '17334170-6282-4ccd-9bb3-5dc7719b1ada', 'fe9642a1-9a54-4e93-9e31-2a37a1608d99', '2503ed71-f5c4-4e6f-9bd8-34d502bb9f68'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:52 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:34:52 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:52 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:52 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-6afd9c4e-68fd-43cf-b18d-51a6196ed47f-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-6afd9c4e-68fd-43cf-b18d-51a6196ed47f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-7b7e3360-0dde-4127-8709-94cd905756a2-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-7b7e3360-0dde-4127-8709-94cd905756a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[df67ff4c-7471-4bfa-af3f-35df1bcd77ed]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "cinder-quobyte-7b7e3360-0dde-4127-8709-94cd905756a2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-7b7e3360-0dde-4127-8709-94cd905756a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a97d6c-dcb0-493d-bdc2-c1028ce832f2]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f Sep 01 00:34:53 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.587s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.461s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:53 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:34:53 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 1G Sep 01 00:34:53 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-1180706f-b76e-41ef-a748-e87fad645fe1 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-8690e9ee-0dc9-42c5-ba45-893d382e15e5-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:53 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 Sep 01 00:34:53 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" returned: 0 in 0.582s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f Sep 01 00:34:53 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2" returned: 0 in 0.528s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2 Sep 01 00:34:53 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 1G" returned: 0 in 0.552s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:53 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:34:53 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:53 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" returned: 0 in 0.320s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-6afd9c4e-68fd-43cf-b18d-51a6196ed47f" released by "delete_volume" :: held 0.991s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:53 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-7b7e3360-0dde-4127-8709-94cd905756a2" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-quobyte-7b7e3360-0dde-4127-8709-94cd905756a2" released by "delete_volume" :: held 0.884s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['987a7beb-b174-45ff-9998-7e6145688a30', '00fba52c-3c0e-47ac-8ce4-85ee1cbae2a0', 'f749cd31-845c-4dfc-8b21-7aefdd803499', '696d05e7-9541-4462-9524-dc4d2442eb53'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Created reservations ['6bafad4d-d435-4197-9922-0b3eca7b1a78', '6d47b6a5-dc89-45e0-b23d-ec64bf43e327', '5c0f4958-6178-4419-8266-c93ab6d184e5', 'f4d24f00-3a4a-4b85-b57a-26263aa1a1af'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:54 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.434s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 is being set with open permissions: ugo+rw Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:54 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:54 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:54 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:34:54 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:54 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:54 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:54 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.337s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:34:54 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:54 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-42410c09-35b7-4d9b-8214-42344e8be280 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-6afd9c4e-68fd-43cf-b18d-51a6196ed47f-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Deleted volume successfully. Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d2a7701-63ae-48db-8ed0-1408a20eb5ef tempest-CreateVolumesFromSourceVolumeTest-150796622 None] Lock "cinder-7b7e3360-0dde-4127-8709-94cd905756a2-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:54 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info Sep 01 00:34:54 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:54 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info" returned: 0 in 0.251s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:54 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info is being set with open permissions: ugo+rw Sep 01 00:34:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:54 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info Sep 01 00:34:54 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:55 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.info" returned: 0 in 0.266s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-32c24b64-ba89-4718-8e9b-58f9c75e489e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-32c24b64-ba89-4718-8e9b-58f9c75e489e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6b7f596d-5725-4ba2-94cf-e59d3203c329 tempest-VolumeDependencyTests-1187896408 None] Create snapshot completed successfully Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-32c24b64-ba89-4718-8e9b-58f9c75e489e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-32c24b64-ba89-4718-8e9b-58f9c75e489e" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[14429e95-b0ec-427b-9bb1-7b5887ebe193]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:55 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e Sep 01 00:34:55 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:55 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e" returned: 0 in 0.431s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:55 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e Sep 01 00:34:55 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:56 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-32c24b64-ba89-4718-8e9b-58f9c75e489e" returned: 0 in 0.325s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-32c24b64-ba89-4718-8e9b-58f9c75e489e" released by "delete_volume" :: held 0.816s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['b9d7e169-6012-4439-8b32-9729a2f4aef3', '494e2727-f8d9-4aa6-980c-d469894c7775', 'c37f970a-408a-4b89-b4c1-0aef56eabd0a', '38b8df06-ef96-4655-a1ca-8d638517522e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:56 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:34:56 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-45610c36-20df-4f20-8df2-5a09a0328587-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-45610c36-20df-4f20-8df2-5a09a0328587-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-45610c36-20df-4f20-8df2-5a09a0328587" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-45610c36-20df-4f20-8df2-5a09a0328587" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleting offline snapshot 45610c36-20df-4f20-8df2-5a09a0328587 of volume 651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] snapshot_file for this snap is: volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a04fa0-4127-48e3-a03d-a8042a8a86c8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:56 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:34:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-07ae834e-d559-495a-91c2-f39f99aa9816 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-32c24b64-ba89-4718-8e9b-58f9c75e489e-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Flow 'volume_create_manager' (d94034e5-7269-4f9a-9636-b3ae866ea9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f52ed1a-6e9f-476d-bcad-90bd5d70f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f52ed1a-6e9f-476d-bcad-90bd5d70f067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-695147724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a7d738-1cc4-432f-ba0c-1daccdbae112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23e6d9c4e9042828f4164f7f52d3fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ffcd36f-1ec1-4ae6-ab15-9395320305b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:57Z,use_quota=True,user_id='3f8b3c269cdd46f289d37e6a04df5d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3eb7d6-4f3e-45b8-9813-e4a03ba56620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3eb7d6-4f3e-45b8-9813-e4a03ba56620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04778d04-4bf5-43ea-bd43-2fded3a822dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:56 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 Sep 01 00:34:56 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04778d04-4bf5-43ea-bd43-2fded3a822dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1a7d738-1cc4-432f-ba0c-1daccdbae112', 'volume_name': 'volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112', 'volume_size': 1, 'snapshot_id': '8ffcd36f-1ec1-4ae6-ab15-9395320305b5'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ffd6c3-5847-445b-a16a-da69f13eda25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ffd6c3-5847-445b-a16a-da69f13eda25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da84a70a-ac39-40d1-9a7d-221a98d289f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Volume b1a7d738-1cc4-432f-ba0c-1daccdbae112: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112', 'volume_size': 1, 'snapshot_id': '8ffcd36f-1ec1-4ae6-ab15-9395320305b5'} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-b1a7d738-1cc4-432f-ba0c-1daccdbae112" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-b1a7d738-1cc4-432f-ba0c-1daccdbae112" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Creating volume b1a7d738-1cc4-432f-ba0c-1daccdbae112 from snapshot 8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] snapshot: 8ffcd36f-1ec1-4ae6-ab15-9395320305b5, volume: b1a7d738-1cc4-432f-ba0c-1daccdbae112, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb989a-bd95-4bc9-b921-2fd4fb7c2f48]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:57 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:34:57 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:57 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587" returned: 0 in 0.625s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-651d41c4-8d50-4b16-a51f-e85cde66013a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d265224-2eba-4615-b1ca-445f8890947f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:57 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a Sep 01 00:34:57 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:57 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.461s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d6a88-4dd6-4bf4-9999-1fa33b744ba3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:57 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:34:57 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:57 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a" returned: 0 in 0.612s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:57 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 Sep 01 00:34:57 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:57 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.566s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:34:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:58 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 Sep 01 00:34:58 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Flow 'volume_create_manager' (f8ee8266-4d76-44e6-abb8-a2e4a3762683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc46a712-7462-421d-aa38-a2df5d520a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc46a712-7462-421d-aa38-a2df5d520a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff8d681-b8c2-4320-98c7-3365228b592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cb9bc215ec4c6fa8b37bff6ac99d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:58Z,use_quota=True,user_id='b56f343072294666ab7deae9a52d7b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b62de5f-231c-4d54-ab3c-a1f2419e9d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b62de5f-231c-4d54-ab3c-a1f2419e9d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49e9ade-202d-4532-94d5-38ccd89cfe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.image.glance [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Creating Keystone auth plugin from conf {{(pid=87803) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 00:34:58 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587" returned: 0 in 0.555s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:58 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587 Sep 01 00:34:58 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49e9ade-202d-4532-94d5-38ccd89cfe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ff8d681-b8c2-4320-98c7-3365228b592f', 'volume_name': 'volume-5ff8d681-b8c2-4320-98c7-3365228b592f', 'volume_size': 1, 'image_id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc602c258d464ba75fd8c5c6ffa00c24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9cb9bc215ec4c6fa8b37bff6ac99d9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0481d1757b6f3d67978c0e965c1d66649eb51dd5ab51716ab48ea0b7e26e1933f0f5542953351206b7bbc1e9b92cff44df7438087f67d43b94a0e7be66fd96', 'id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cdcbabc-a853-45ce-83c5-19eabc152995/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8e8669-f715-4bdb-a22f-e30710b583b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8e8669-f715-4bdb-a22f-e30710b583b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f551c14-2d4c-4a12-8367-17d821a1b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:34:58 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Volume 5ff8d681-b8c2-4320-98c7-3365228b592f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ff8d681-b8c2-4320-98c7-3365228b592f', 'volume_size': 1, 'image_id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc602c258d464ba75fd8c5c6ffa00c24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9cb9bc215ec4c6fa8b37bff6ac99d9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0481d1757b6f3d67978c0e965c1d66649eb51dd5ab51716ab48ea0b7e26e1933f0f5542953351206b7bbc1e9b92cff44df7438087f67d43b94a0e7be66fd96', 'id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cdcbabc-a853-45ce-83c5-19eabc152995/file', 'properties': {}}, 'image_service': } Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Trying to clone 5ff8d681-b8c2-4320-98c7-3365228b592f from image 5cdcbabc-a853-45ce-83c5-19eabc152995 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}]). {{(pid=87803) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 00:34:58 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 01 00:34:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a.45610c36-20df-4f20-8df2-5a09a0328587" returned: 0 in 0.503s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-45610c36-20df-4f20-8df2-5a09a0328587" released by "_delete_snapshot" :: held 2.527s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" released by "delete_snapshot" :: held 2.589s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 00:34:59 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Image download 0.00 MB at 0.00 MB/s Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[40756438-ec35-4095-a299-5f5c3ee3448b]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['1d4eafb7-f608-4e32-9b47-6aa26b4f26b0', 'a1ef41de-9a67-4938-80dc-0b420b609825', '75c9c7e3-6a78-4383-8f91-4d638fe44e82', '037c787b-29fe-43d9-b7ef-82e425ddac93'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:34:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Delete snapshot completed successfully. Sep 01 00:34:59 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-aa47f310-dc0c-4934-aa42-414193d60d43 tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-45610c36-20df-4f20-8df2-5a09a0328587-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:34:59 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-651d41c4-8d50-4b16-a51f-e85cde66013a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:34:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-651d41c4-8d50-4b16-a51f-e85cde66013a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" acquired by "delete_volume" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f416b86-8739-43d3-8795-1e2137929a3d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Flow 'volume_create_manager' (916d6207-b263-4aab-8b76-721eee79f2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:00 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a Sep 01 00:35:00 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c08961-afb4-4248-b6aa-3273d7dabd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:00 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 0 in 1.264s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c08961-afb4-4248-b6aa-3273d7dabd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338c2d12-12f6-448f-b83b-7385e2fdc0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efc8d610b6e48e2a8be89032cb675fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:00Z,use_quota=True,user_id='3abacfeb8afe46c7ad3e5dd354937592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fdabe7-b3b0-4ed7-814b-a4952f23dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fdabe7-b3b0-4ed7-814b-a4952f23dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e314727-8a9d-4217-ad61-604fda516cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e314727-8a9d-4217-ad61-604fda516cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338c2d12-12f6-448f-b83b-7385e2fdc0eb', 'volume_name': 'volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fceb1dc7-22b4-453d-bfc5-e260a828b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fceb1dc7-22b4-453d-bfc5-e260a828b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519994cd-001e-4547-a33b-46562f750cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Volume 338c2d12-12f6-448f-b83b-7385e2fdc0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb', 'volume_size': 1} Sep 01 00:35:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:00 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:35:00 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:01 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a" returned: 0 in 0.759s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:01 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a Sep 01 00:35:01 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:01 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 1 in 0.711s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Temporary image 5cdcbabc-a853-45ce-83c5-19eabc152995 is fetched for user b56f343072294666ab7deae9a52d7b77. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 00:35:01 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-651d41c4-8d50-4b16-a51f-e85cde66013a" returned: 0 in 0.479s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9368c01-8b36-41b9-86a5-d62fce3594b9]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-quobyte-651d41c4-8d50-4b16-a51f-e85cde66013a" released by "delete_volume" :: held 1.501s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:01 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Created reservations ['4d3054a5-69da-4bed-9ff2-af3a05473265', 'e2147934-2341-44c9-bbdf-8e1cd0f13677', '661875ed-8f2e-4497-b5e4-7b4692cbbb83', '6c9a2891-4aa8-4769-9b53-e18b4f0f68d4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:02 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:35:02 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:02 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:02 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:02 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 0 in 1.030s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:02 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:35:02 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:03 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 1.116s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:03 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Deleted volume successfully. Sep 01 00:35:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72e49e09-f4f2-4c30-82d0-747ea470e0cb tempest-CreateVolumesFromSnapshotTest-880551373 None] Lock "cinder-651d41c4-8d50-4b16-a51f-e85cde66013a-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:04 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112" returned: 0 in 6.057s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:35:04 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Converted 1024.00 MB image at 169.02 MB/s Sep 01 00:35:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 is being set with open permissions: ugo+rw Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:04 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 Sep 01 00:35:04 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:04 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112" returned: 0 in 0.291s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" released by "_copy_volume_from_snapshot" :: held 7.516s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-b1a7d738-1cc4-432f-ba0c-1daccdbae112" released by "_create_volume_from_snapshot" :: held 7.661s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.683s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.649s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338c2d12-12f6-448f-b83b-7385e2fdc0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efc8d610b6e48e2a8be89032cb675fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:00Z,use_quota=True,user_id='3abacfeb8afe46c7ad3e5dd354937592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Creating volume 338c2d12-12f6-448f-b83b-7385e2fdc0eb {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:04 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:04 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb 1073741824 Sep 01 00:35:04 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da84a70a-ac39-40d1-9a7d-221a98d289f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112', 'volume_size': 1, 'snapshot_id': '8ffcd36f-1ec1-4ae6-ab15-9395320305b5'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a70bba2-3946-4ae9-af45-063dc3420762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:04 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Volume volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 (b1a7d738-1cc4-432f-ba0c-1daccdbae112): created successfully Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a70bba2-3946-4ae9-af45-063dc3420762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:04 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Flow 'volume_create_manager' (d94034e5-7269-4f9a-9636-b3ae866ea9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:04 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-ac69b55d-543e-47d9-8aa4-8f8f75717cec tempest-VolumeDependencyTests-1187896408 None] Created volume successfully. Sep 01 00:35:05 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb 1073741824" returned: 0 in 0.504s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:05 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb Sep 01 00:35:05 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:05 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb" returned: 0 in 0.324s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.980s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff8d681-b8c2-4320-98c7-3365228b592f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cb9bc215ec4c6fa8b37bff6ac99d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:34:58Z,use_quota=True,user_id='b56f343072294666ab7deae9a52d7b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Creating volume 5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:05 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519994cd-001e-4547-a33b-46562f750cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6f72f7-0099-487b-a57a-63ccb24bc9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:05 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1073741824 Sep 01 00:35:05 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:05 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Volume volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb (338c2d12-12f6-448f-b83b-7385e2fdc0eb): created successfully Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6f72f7-0099-487b-a57a-63ccb24bc9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Flow 'volume_create_manager' (916d6207-b263-4aab-8b76-721eee79f2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-071e8a5e-e886-4ebb-9465-e41a6b0c6de6 tempest-CinderUnicodeTest-1814020787 None] Created volume successfully. Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Deleting offline snapshot 8ffcd36f-1ec1-4ae6-ab15-9395320305b5 of volume ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] snapshot_file for this snap is: volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[39faa0a9-1842-47bf-b0fa-cc3b358e1246]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:05 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:35:05 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:06 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1073741824" returned: 0 in 0.642s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:06 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f Sep 01 00:35:06 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:06 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.526s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43850d-7ca4-46f6-9c87-22184ac40a48]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:06 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:35:06 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Flow 'volume_create_manager' (7684fadc-6152-49e0-83b4-b5e72e43ac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4d8483-87bc-4c55-854e-6456d7a05a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f" returned: 0 in 0.421s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4d8483-87bc-4c55-854e-6456d7a05a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1318068497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efc8d610b6e48e2a8be89032cb675fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:06Z,use_quota=True,user_id='3abacfeb8afe46c7ad3e5dd354937592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fc40b-6ae2-41d1-8528-ff7c41a99421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379fc40b-6ae2-41d1-8528-ff7c41a99421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e62def-f5e0-47c4-99af-a00f22bffa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e62def-f5e0-47c4-99af-a00f22bffa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a', 'volume_name': 'volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822c1259-cdfc-4d2b-84d5-8dbc34c83b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822c1259-cdfc-4d2b-84d5-8dbc34c83b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a62e3-6330-4dbc-aa64-bfb094d22bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:06 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Volume 1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a', 'volume_size': 1} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1318068497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efc8d610b6e48e2a8be89032cb675fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:06Z,use_quota=True,user_id='3abacfeb8afe46c7ad3e5dd354937592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Creating volume 1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:06 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:06 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a 1073741824 Sep 01 00:35:06 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Attempting download of 5cdcbabc-a853-45ce-83c5-19eabc152995 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}])) to volume 5ff8d681-b8c2-4320-98c7-3365228b592f. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e4724d-cb36-4b61-80a0-502927d2ec36]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:06 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.650s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:06 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4 Sep 01 00:35:06 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:06 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:35:06 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:07 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4" returned: 0 in 0.435s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:07 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a 1073741824" returned: 0 in 0.601s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:07 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a Sep 01 00:35:07 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:07 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4 Sep 01 00:35:07 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:07 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.508s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:07 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5 Sep 01 00:35:07 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:07 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" returned: 0 in 0.305s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614a62e3-6330-4dbc-aa64-bfb094d22bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1655dd-6925-4874-ade4-5fe4be662ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Volume volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a (1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a): created successfully Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1655dd-6925-4874-ade4-5fe4be662ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Flow 'volume_create_manager' (7684fadc-6152-49e0-83b4-b5e72e43ac16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:07 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4" returned: 1 in 0.471s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cdcbabc-a853-45ce-83c5-19eabc152995_c8rd4ou4' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:35:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a13b8313-3b7c-4669-9ff3-bf91b6eea33c tempest-CinderUnicodeTest-1814020787 None] Created volume successfully. Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6451006a-2af6-493d-a48b-65739286e7a4]: (4, 'raw') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:07 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8.8ffcd36f-1ec1-4ae6-ab15-9395320305b5" returned: 0 in 0.299s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-8ffcd36f-1ec1-4ae6-ab15-9395320305b5" released by "_delete_snapshot" :: held 2.133s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" released by "delete_snapshot" :: held 2.167s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:07 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:35:07 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Created reservations ['6c66110b-bf8d-423d-9adf-ba607528ed2b', '1a4735af-58aa-4a90-81d8-fcaebaf80084', 'e0c479d3-5337-418d-8c19-80810d23b23f', '76f16751-5d52-40e5-a1a9-69e66524983c'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Delete snapshot completed successfully. Sep 01 00:35:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fbd96b7e-97c9-4d29-8300-21c87ab5c58c tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-8ffcd36f-1ec1-4ae6-ab15-9395320305b5-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:08 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (2d6df36e-5c8b-4b37-9ec5-ceb05488d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7525f-a0dd-4581-8bba-2d476fd038c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f7525f-a0dd-4581-8bba-2d476fd038c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16516006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c274111-a438-49bf-8aa9-576cb1c1f56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:08Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f587a269-d90b-4577-af77-0df52ec4a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f587a269-d90b-4577-af77-0df52ec4a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506f4ad8-fc7b-478b-abbc-e6cb1299d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506f4ad8-fc7b-478b-abbc-e6cb1299d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c274111-a438-49bf-8aa9-576cb1c1f56a', 'volume_name': 'volume-4c274111-a438-49bf-8aa9-576cb1c1f56a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:08 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD Sep 01 00:35:08 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42bd46-5c99-47a0-b105-e6ef50cadbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42bd46-5c99-47a0-b105-e6ef50cadbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1922310f-67cf-4188-9e93-eba1d5abfbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:08 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Volume 4c274111-a438-49bf-8aa9-576cb1c1f56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c274111-a438-49bf-8aa9-576cb1c1f56a', 'volume_size': 1} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16516006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c274111-a438-49bf-8aa9-576cb1c1f56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:08Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Creating volume 4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:08 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:08 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a 1073741824 Sep 01 00:35:08 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:08 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] 5cdcbabc-a853-45ce-83c5-19eabc152995 was raw, converting to qcow2 {{(pid=87803) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:08 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f Sep 01 00:35:08 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-ac2f258c-74a9-4c05-8cc7-76843202d0f8-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:08 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a 1073741824" returned: 0 in 0.581s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-ac2f258c-74a9-4c05-8cc7-76843202d0f8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:08 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a Sep 01 00:35:08 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a73fe1-60f6-4447-8134-4f5c67f6ad7b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f" returned: 0 in 0.627s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5cdcbabc-a853-45ce-83c5-19eabc152995_vz2miiixdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:35:09 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1G Sep 01 00:35:09 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:09 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.329s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1922310f-67cf-4188-9e93-eba1d5abfbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c274111-a438-49bf-8aa9-576cb1c1f56a', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60741a96-a051-48e3-ba67-86554040328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Creating offline snapshot fdce834d-31f9-4213-9b2a-8267ede130bc of volume 1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Volume volume-4c274111-a438-49bf-8aa9-576cb1c1f56a (4c274111-a438-49bf-8aa9-576cb1c1f56a): created successfully Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60741a96-a051-48e3-ba67-86554040328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (2d6df36e-5c8b-4b37-9ec5-ceb05488d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[7959b6f9-d4dd-4557-90c5-2546bdeb8819]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b9372020-ac12-4da7-91b5-faf3d079a005 tempest-ProjectReaderTests-146138966 None] Created volume successfully. Sep 01 00:35:09 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.451s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8 Sep 01 00:35:09 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:09 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a Sep 01 00:35:09 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:09 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f 1G" returned: 0 in 0.432s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Downloaded image 5cdcbabc-a853-45ce-83c5-19eabc152995 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}])) to volume 5ff8d681-b8c2-4320-98c7-3365228b592f successfully. {{(pid=87803) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Temporary image 5cdcbabc-a853-45ce-83c5-19eabc152995 for user b56f343072294666ab7deae9a52d7b77 is deleted. {{(pid=87803) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.volume_utils [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Marking volume 5ff8d681-b8c2-4320-98c7-3365228b592f as bootable. {{(pid=87803) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Copying metadata from image 5cdcbabc-a853-45ce-83c5-19eabc152995 to 5ff8d681-b8c2-4320-98c7-3365228b592f. {{(pid=87803) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Creating volume glance metadata for volume 5ff8d681-b8c2-4320-98c7-3365228b592f backed by image 5cdcbabc-a853-45ce-83c5-19eabc152995 with: {'image_id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc602c258d464ba75fd8c5c6ffa00c24', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87803) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f551c14-2d4c-4a12-8367-17d821a1b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff8d681-b8c2-4320-98c7-3365228b592f', 'volume_size': 1, 'image_id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cdcbabc-a853-45ce-83c5-19eabc152995', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc602c258d464ba75fd8c5c6ffa00c24', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a9cb9bc215ec4c6fa8b37bff6ac99d9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e0481d1757b6f3d67978c0e965c1d66649eb51dd5ab51716ab48ea0b7e26e1933f0f5542953351206b7bbc1e9b92cff44df7438087f67d43b94a0e7be66fd96', 'id': '5cdcbabc-a853-45ce-83c5-19eabc152995', 'created_at': datetime.datetime(2026, 8, 31, 22, 34, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 22, 34, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cdcbabc-a853-45ce-83c5-19eabc152995/file', 'properties': {}}, 'image_service': }' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bb252f-16dc-4063-995e-bfdf87044567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Volume volume-5ff8d681-b8c2-4320-98c7-3365228b592f (5ff8d681-b8c2-4320-98c7-3365228b592f): created successfully Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bb252f-16dc-4063-995e-bfdf87044567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Flow 'volume_create_manager' (f8ee8266-4d76-44e6-abb8-a2e4a3762683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e926832d-d873-43c2-8c97-0eb227f0d557 tempest-VolumeImageDependencyTests-1931320998 None] Created volume successfully. Sep 01 00:35:09 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ac2f258c-74a9-4c05-8cc7-76843202d0f8" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-ac2f258c-74a9-4c05-8cc7-76843202d0f8" released by "delete_volume" :: held 0.821s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:09 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc 1G Sep 01 00:35:09 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Created reservations ['2cbe3c3a-6eba-483e-8eb7-99dbd3792582', '923df69a-728d-4582-a70d-84d6b5d34608', 'f96371be-de0d-4145-8434-bcb3366f0588', 'a240ffd4-9db8-46c3-97e0-ce2b32fa8435'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:09 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:09 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-b1a7d738-1cc4-432f-ba0c-1daccdbae112-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-b1a7d738-1cc4-432f-ba0c-1daccdbae112-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a7f5d2-9d0c-46eb-8f56-e256ec4d1722]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:10 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 Sep 01 00:35:10 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.329s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:10 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Deleted volume successfully. Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc 1G" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6958ff3f-15c4-47ec-8d5d-558ad475af3a tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-ac2f258c-74a9-4c05-8cc7-76843202d0f8-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:10 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc Sep 01 00:35:10 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Acquiring lock "cinder-5ff8d681-b8c2-4320-98c7-3365228b592f-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "cinder-5ff8d681-b8c2-4320-98c7-3365228b592f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:10 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Acquiring lock "cinder-quobyte-5ff8d681-b8c2-4320-98c7-3365228b592f" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112" returned: 0 in 0.561s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:10 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc" returned: 0 in 0.414s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:10 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc is being set with open permissions: ugo+rw Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "cinder-quobyte-5ff8d681-b8c2-4320-98c7-3365228b592f" acquired by "delete_volume" :: waited 0.043s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:10 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112 Sep 01 00:35:10 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc Sep 01 00:35:10 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae318721-ca90-47d6-a771-0d06954a9faf]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:10 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f Sep 01 00:35:10 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:10 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-b1a7d738-1cc4-432f-ba0c-1daccdbae112" returned: 0 in 0.319s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-quobyte-b1a7d738-1cc4-432f-ba0c-1daccdbae112" released by "delete_volume" :: held 0.926s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info Sep 01 00:35:11 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Created reservations ['40a7e4bb-cf7e-417d-8607-12202c9eabdb', '291892a4-f8d7-4bad-b7dd-c84289fb7bd8', '0b20f7a7-dbba-4f01-a5ab-2c3baa12a75b', 'f1cc8b90-ea69-449c-a1a0-ecb335d500dd'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:11 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f" returned: 0 in 0.487s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:11 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:11 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f Sep 01 00:35:11 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:11 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info" returned: 0 in 0.308s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info is being set with open permissions: ugo+rw Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info Sep 01 00:35:11 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:11 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-5ff8d681-b8c2-4320-98c7-3365228b592f" returned: 0 in 0.316s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.340s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "cinder-quobyte-5ff8d681-b8c2-4320-98c7-3365228b592f" released by "delete_volume" :: held 0.858s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Deleted volume successfully. Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-72ac81e4-0e47-459b-8acf-8b41fb5ddda6 tempest-VolumeDependencyTests-1187896408 None] Lock "cinder-b1a7d738-1cc4-432f-ba0c-1daccdbae112-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Created reservations ['59030ce4-c256-49c6-a034-3d6fb9071018', '10d395b1-bc9c-4b49-89e4-a43ff9bdd6e2', '3b883ed1-07f4-4f45-9377-a5f2383b1016', '816d59e5-5eec-4c63-b5ac-ef43fc7f4342'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:11 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.info" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.134s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Creating offline snapshot 9d44994e-cad9-411f-a614-ca196e9daf21 of volume 4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-75fdc2e3-b315-4dcb-8be7-20db4e1495fc tempest-CinderUnicodeTest-1814020787 None] Create snapshot completed successfully Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc0f6a-0412-4402-9d80-e8653ab23571]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:11 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:11 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:11 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a Sep 01 00:35:11 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:12 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.321s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-fdce834d-31f9-4213-9b2a-8267ede130bc-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:12 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Deleted volume successfully. Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-fdce834d-31f9-4213-9b2a-8267ede130bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-bc2fd397-6fb0-489b-b026-56d5a4bb5c1f tempest-VolumeImageDependencyTests-1931320998 None] Lock "cinder-5ff8d681-b8c2-4320-98c7-3365228b592f-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-quobyte-fdce834d-31f9-4213-9b2a-8267ede130bc" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-fdce834d-31f9-4213-9b2a-8267ede130bc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Deleting offline snapshot fdce834d-31f9-4213-9b2a-8267ede130bc of volume 1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:12 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] snapshot_file for this snap is: volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a" returned: 0 in 0.491s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef91529-2815-45fe-942c-67a975ec871a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:12 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 1G Sep 01 00:35:12 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:12 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc Sep 01 00:35:12 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:12 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d082d93-34f8-4494-960c-84d7ed15010d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:12 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 1G" returned: 0 in 0.595s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c274111-a438-49bf-8aa9-576cb1c1f56a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:12 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c274111-a438-49bf-8aa9-576cb1c1f56a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 Sep 01 00:35:12 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:12 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a Sep 01 00:35:12 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:13 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c274111-a438-49bf-8aa9-576cb1c1f56a -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21" returned: 0 in 0.425s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:13 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 is being set with open permissions: ugo+rw Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:13 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" returned: 0 in 0.511s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:13 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 Sep 01 00:35:13 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:13 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc Sep 01 00:35:13 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:35:13 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21" returned: 0 in 0.369s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:13 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info Sep 01 00:35:13 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:13 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc" returned: 0 in 0.492s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:13 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc Sep 01 00:35:13 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:14 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:14 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info is being set with open permissions: ugo+rw Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:14 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info Sep 01 00:35:14 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:14 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a.fdce834d-31f9-4213-9b2a-8267ede130bc" returned: 0 in 0.362s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-fdce834d-31f9-4213-9b2a-8267ede130bc" released by "_delete_snapshot" :: held 1.998s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" released by "delete_snapshot" :: held 2.033s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Created reservations ['7c4873cf-0950-4a59-ae55-9438dd2e21f7', '1778a1ae-b3c9-41c2-922e-e51bef2e4a2f', '86e684fd-7dc3-42fb-841e-73ec89bb0119', 'efa5ba48-37e9-4534-9409-b4e91032aec2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:14 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.info" returned: 0 in 0.369s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.733s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Delete snapshot completed successfully. Sep 01 00:35:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e27fa35c-cb39-4f19-bd3a-5014d18d9a5d tempest-ProjectReaderTests-146138966 None] Create snapshot completed successfully Sep 01 00:35:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-97d932b5-c1d9-45ef-8524-7c0415c52f7b tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-fdce834d-31f9-4213-9b2a-8267ede130bc-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-9d44994e-cad9-411f-a614-ca196e9daf21-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-9d44994e-cad9-411f-a614-ca196e9daf21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-9d44994e-cad9-411f-a614-ca196e9daf21" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-9d44994e-cad9-411f-a614-ca196e9daf21" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Deleting offline snapshot 9d44994e-cad9-411f-a614-ca196e9daf21 of volume 4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] snapshot_file for this snap is: volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8bdfa1-eed6-4829-ab36-b015db9e63d1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:15 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 Sep 01 00:35:15 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" acquired by "delete_volume" :: waited 0.030s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240b89d-ef12-4737-a3d6-c2362a3df265]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:15 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21" returned: 0 in 0.470s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c274111-a438-49bf-8aa9-576cb1c1f56a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f786c-2d86-4c45-8b64-e11eebbab743]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:15 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a Sep 01 00:35:15 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:15 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a Sep 01 00:35:15 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:16 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" returned: 0 in 0.471s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:16 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a Sep 01 00:35:16 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:16 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a" returned: 0 in 0.484s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:16 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 Sep 01 00:35:16 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:16 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" returned: 0 in 0.414s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a" released by "delete_volume" :: held 0.973s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Created reservations ['ff3762ba-6237-4cca-90ba-dbdfab900f83', '1801aab4-48b1-4735-882a-97b73dc1e98e', '7afd8f97-35fd-4032-8855-ef3d6573b902', '4a4ea28c-561c-4467-883c-4e35e17494c5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:16 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21" returned: 0 in 0.535s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:16 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:16 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:16 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21 Sep 01 00:35:16 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-4fb73229-9141-402d-b3e6-812e6e77cfc7 tempest-ProjectAdminTests-873553726 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.3857078552246, 'free_capacity_gb': 1774.3857078552246, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87803) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-338c2d12-12f6-448f-b83b-7385e2fdc0eb-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-338c2d12-12f6-448f-b83b-7385e2fdc0eb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "cinder-quobyte-338c2d12-12f6-448f-b83b-7385e2fdc0eb" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:17 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a.9d44994e-cad9-411f-a614-ca196e9daf21" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:17 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.447s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-9d44994e-cad9-411f-a614-ca196e9daf21" released by "_delete_snapshot" :: held 1.998s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Deleted volume successfully. Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-338c2d12-12f6-448f-b83b-7385e2fdc0eb" acquired by "delete_volume" :: waited 0.071s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" released by "delete_snapshot" :: held 2.060s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[51109751-2d3a-4fbf-a6ef-2651ce1a8924]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fe9818f2-11a8-45f4-b893-f3006244475a tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-1f458b3b-4e71-4acd-b7dc-bc0a1036aa3a-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Created reservations ['9fdab0bd-77a3-42e8-9623-65c8eb0efaa4', 'd5941503-1be9-4ab2-84e5-0c8954f76279', '2488d862-ef3d-41ee-b578-be2e30241dd3', '5d92ea4f-d37f-4d05-b1a2-a9be9722795a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:17 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb Sep 01 00:35:17 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:17 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Delete snapshot completed successfully. Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-909b56e5-a730-4088-aa6f-bf7c2c790c78 tempest-ProjectReaderTests-146138966 None] Lock "cinder-9d44994e-cad9-411f-a614-ca196e9daf21-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:17 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb" returned: 0 in 0.470s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:17 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb Sep 01 00:35:17 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:17 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-338c2d12-12f6-448f-b83b-7385e2fdc0eb" returned: 0 in 0.254s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-quobyte-338c2d12-12f6-448f-b83b-7385e2fdc0eb" released by "delete_volume" :: held 0.793s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Created reservations ['7106d8ba-2bbc-456a-9261-5d31fe606174', '05b74763-684e-4ce0-9f92-3f582ef7ba13', 'fabedb20-3b42-4ecd-92c9-037b7a20a9d4', '8437c293-ca90-47b5-9a0b-60b4b4a6f52b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:18 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:18 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-4c274111-a438-49bf-8aa9-576cb1c1f56a-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "cinder-4c274111-a438-49bf-8aa9-576cb1c1f56a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:18 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.355s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Deleted volume successfully. Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a706b95-1928-46e0-83f1-73854770c4da tempest-CinderUnicodeTest-1814020787 None] Lock "cinder-338c2d12-12f6-448f-b83b-7385e2fdc0eb-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dd05fe-09e5-4b67-a995-329915a0a878]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:18 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a Sep 01 00:35:18 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:19 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a" returned: 0 in 0.600s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:19 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a Sep 01 00:35:19 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:19 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-4c274111-a438-49bf-8aa9-576cb1c1f56a" returned: 0 in 0.383s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4c274111-a438-49bf-8aa9-576cb1c1f56a" released by "delete_volume" :: held 1.087s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Created reservations ['128d27fe-311d-46c6-8a98-8853fb401fea', '8e7af079-efbf-4b30-bc84-cc0dd86a40c0', '664cc271-1bda-419c-8917-249fbf82baa1', 'd836dd63-94a3-48f6-a634-2696b32c9dc5'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:19 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:19 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:20 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.326s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:20 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:20 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Deleted volume successfully. Sep 01 00:35:20 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d94e7b94-afb0-4157-8355-3f3710f8b9f5 tempest-ProjectReaderTests-146138966 None] Lock "cinder-4c274111-a438-49bf-8aa9-576cb1c1f56a-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=208,cinder:UPDATE=318,cinder:INSERT=72,cinder:DELETE=28 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=274,cinder:SELECT=224,cinder:INSERT=87,cinder:DELETE=24 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (7ea18546-44c8-48fb-ba5f-e1e7966fedc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5fc9af-1cc0-4b2a-82b7-2f60fe46e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5fc9af-1cc0-4b2a-82b7-2f60fe46e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337576286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46744cab-02d7-426a-91e4-1be1c8872ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:21Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8cf9c3-5841-4e66-b056-34b5af89ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8cf9c3-5841-4e66-b056-34b5af89ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7a628d-e129-4833-8b67-63c3593d4c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7a628d-e129-4833-8b67-63c3593d4c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46744cab-02d7-426a-91e4-1be1c8872ca8', 'volume_name': 'volume-46744cab-02d7-426a-91e4-1be1c8872ca8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000add97-8f5e-4778-b82f-42c33ae48e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000add97-8f5e-4778-b82f-42c33ae48e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03be011c-88c3-4d52-846b-7d102104b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:21 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Volume 46744cab-02d7-426a-91e4-1be1c8872ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46744cab-02d7-426a-91e4-1be1c8872ca8', 'volume_size': 1} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337576286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46744cab-02d7-426a-91e4-1be1c8872ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:21Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Creating volume 46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:21 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:21 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 1073741824 Sep 01 00:35:21 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:22 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 1073741824" returned: 0 in 0.586s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:22 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 Sep 01 00:35:22 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:22 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8" returned: 0 in 0.344s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03be011c-88c3-4d52-846b-7d102104b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46744cab-02d7-426a-91e4-1be1c8872ca8', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144fc938-5094-4162-abc4-3a013e76e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Volume volume-46744cab-02d7-426a-91e4-1be1c8872ca8 (46744cab-02d7-426a-91e4-1be1c8872ca8): created successfully Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144fc938-5094-4162-abc4-3a013e76e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (7ea18546-44c8-48fb-ba5f-e1e7966fedc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3018df06-3243-4996-be1d-c32233951cd7 tempest-ProjectReaderTests-146138966 None] Created volume successfully. Sep 01 00:35:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Creating offline snapshot 6a1fee1d-6949-425c-8299-f61897693bd7 of volume 46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:23 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4424f9c-2a99-4856-876f-39b9cd91c338]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:23 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 Sep 01 00:35:23 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:24 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 1G Sep 01 00:35:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:24 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 1G" returned: 0 in 0.505s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46744cab-02d7-426a-91e4-1be1c8872ca8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:24 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46744cab-02d7-426a-91e4-1be1c8872ca8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 Sep 01 00:35:24 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:25 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46744cab-02d7-426a-91e4-1be1c8872ca8 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7" returned: 0 in 0.376s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:25 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 is being set with open permissions: ugo+rw Sep 01 00:35:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:25 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 Sep 01 00:35:25 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:25 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7" returned: 0 in 0.518s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:25 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info Sep 01 00:35:25 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:26 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:26 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info is being set with open permissions: ugo+rw Sep 01 00:35:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:26 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info Sep 01 00:35:26 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:26 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.info" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:26 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4258f093-5970-496c-b324-3214f0371973 tempest-ProjectReaderTests-146138966 None] Create snapshot completed successfully Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-6a1fee1d-6949-425c-8299-f61897693bd7-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-6a1fee1d-6949-425c-8299-f61897693bd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-6a1fee1d-6949-425c-8299-f61897693bd7" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-6a1fee1d-6949-425c-8299-f61897693bd7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Deleting offline snapshot 6a1fee1d-6949-425c-8299-f61897693bd7 of volume 46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] snapshot_file for this snap is: volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed6d9b-ae6a-4046-9bc2-fbe6ee0240a3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:27 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 Sep 01 00:35:27 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:27 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7" returned: 0 in 0.504s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46744cab-02d7-426a-91e4-1be1c8872ca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0910a3-a18d-4c52-94ed-22fbce973c5b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:27 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 Sep 01 00:35:27 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:28 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8" returned: 0 in 0.481s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:28 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 Sep 01 00:35:28 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Flow 'volume_create_manager' (362e5c47-f59d-409d-98f1-614f8bd54218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f834ef-8816-4ba7-b1a2-56aea0ebc7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f834ef-8816-4ba7-b1a2-56aea0ebc7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856070887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fafc4b-991d-425f-b6b8-c84282a84e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2eeb2fbcb140d48cc025d20fb64701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:29Z,use_quota=True,user_id='b93cbed890b6441bba64f0fca649ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333afe26-67ca-45c8-8d08-f5dd57d3b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333afe26-67ca-45c8-8d08-f5dd57d3b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27004a27-4f05-40a2-9751-9a86cd26c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27004a27-4f05-40a2-9751-9a86cd26c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fafc4b-991d-425f-b6b8-c84282a84e34', 'volume_name': 'volume-85fafc4b-991d-425f-b6b8-c84282a84e34', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74188527-18a1-4f0d-85d4-614b41a44ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74188527-18a1-4f0d-85d4-614b41a44ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4e60c7-f2b4-487d-999a-b4d6acdca873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:28 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Volume 85fafc4b-991d-425f-b6b8-c84282a84e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fafc4b-991d-425f-b6b8-c84282a84e34', 'volume_size': 1} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856070887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fafc4b-991d-425f-b6b8-c84282a84e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2eeb2fbcb140d48cc025d20fb64701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:29Z,use_quota=True,user_id='b93cbed890b6441bba64f0fca649ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Creating volume 85fafc4b-991d-425f-b6b8-c84282a84e34 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:28 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:28 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7" returned: 0 in 0.524s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:28 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 1073741824 Sep 01 00:35:28 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:28 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7 Sep 01 00:35:28 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:29 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8.6a1fee1d-6949-425c-8299-f61897693bd7" returned: 0 in 0.291s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-6a1fee1d-6949-425c-8299-f61897693bd7" released by "_delete_snapshot" :: held 1.965s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" released by "delete_snapshot" :: held 2.003s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Created reservations ['a0f62be0-b826-4d80-823e-91cd94f3e1d0', '886da278-b44b-43b5-9fd4-fae172cc74bc', '2e4d3a47-d202-4153-8389-7c36b825d9fc', 'c59dd275-fed8-46a1-beda-58f860cc29bb'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Delete snapshot completed successfully. Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7bd306d5-f94d-45c4-8bde-3374e5d6dbae tempest-ProjectReaderTests-146138966 None] Lock "cinder-6a1fee1d-6949-425c-8299-f61897693bd7-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:29 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 1073741824" returned: 0 in 0.625s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:29 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 Sep 01 00:35:29 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (10d3aa12-54a3-427d-8518-1ef3ca75881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41254edb-193f-4bce-babe-fa33d14f7d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41254edb-193f-4bce-babe-fa33d14f7d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717850558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb7f2f9-b0c3-4c64-919a-2b0584372528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:30Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d016b593-447d-4778-b045-b318e67efaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d016b593-447d-4778-b045-b318e67efaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82aae8a-5fe0-4c65-88db-d9a598b658f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82aae8a-5fe0-4c65-88db-d9a598b658f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb7f2f9-b0c3-4c64-919a-2b0584372528', 'volume_name': 'volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f51360-a062-4a38-8fec-3d83fd744e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f51360-a062-4a38-8fec-3d83fd744e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b4d3fc-78a8-4d52-b51d-1e4b7224d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Volume bdb7f2f9-b0c3-4c64-919a-2b0584372528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528', 'volume_size': 1} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34" returned: 0 in 0.342s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717850558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb7f2f9-b0c3-4c64-919a-2b0584372528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:30Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Creating volume bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:29 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4e60c7-f2b4-487d-999a-b4d6acdca873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fafc4b-991d-425f-b6b8-c84282a84e34', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 1073741824 Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cf1cb1-d66c-4b96-b8a8-0e8decb04442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:29 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:29 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Volume volume-85fafc4b-991d-425f-b6b8-c84282a84e34 (85fafc4b-991d-425f-b6b8-c84282a84e34): created successfully Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cf1cb1-d66c-4b96-b8a8-0e8decb04442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:29 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Flow 'volume_create_manager' (362e5c47-f59d-409d-98f1-614f8bd54218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:29 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-933e9ed7-ce97-4203-856a-f0a330ff1c5a tempest-ProjectReaderTests-1481137753 None] Created volume successfully. Sep 01 00:35:30 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 1073741824" returned: 0 in 0.488s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-46744cab-02d7-426a-91e4-1be1c8872ca8-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:30 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 Sep 01 00:35:30 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "cinder-46744cab-02d7-426a-91e4-1be1c8872ca8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f492b-ea74-4492-91d4-68bc1ede9a66]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:30 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 Sep 01 00:35:30 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:30 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528" returned: 0 in 0.296s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b4d3fc-78a8-4d52-b51d-1e4b7224d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05521a43-8a26-4099-81c4-ea4bb5c389ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:30 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Volume volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 (bdb7f2f9-b0c3-4c64-919a-2b0584372528): created successfully Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05521a43-8a26-4099-81c4-ea4bb5c389ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (10d3aa12-54a3-427d-8518-1ef3ca75881e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8c5f2909-27b0-4f16-bc76-3bbc2341f8a2 tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:35:30 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8" returned: 0 in 0.392s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:30 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8 Sep 01 00:35:30 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Acquiring lock "cinder-85fafc4b-991d-425f-b6b8-c84282a84e34-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "cinder-85fafc4b-991d-425f-b6b8-c84282a84e34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Acquiring lock "cinder-quobyte-85fafc4b-991d-425f-b6b8-c84282a84e34" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "cinder-quobyte-85fafc4b-991d-425f-b6b8-c84282a84e34" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ac825-9355-4583-98e8-170f4b9d1bbf]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:31 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-46744cab-02d7-426a-91e4-1be1c8872ca8" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-46744cab-02d7-426a-91e4-1be1c8872ca8" released by "delete_volume" :: held 0.735s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:31 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 Sep 01 00:35:31 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Created reservations ['73d60753-2db3-4bd7-b96e-f6dad926113a', '79ed5583-9528-444a-9047-40bc6cfaed63', 'a432063d-b030-4a38-b949-eccf971c90ae', 'a3f617fe-c4e6-4347-bd2c-e8bd20acaef4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:31 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:31 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:31 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34" returned: 0 in 0.396s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:31 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34 Sep 01 00:35:31 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:31 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.316s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Deleted volume successfully. Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f3f6216-0259-4195-948e-692a21535889 tempest-ProjectReaderTests-146138966 None] Lock "cinder-46744cab-02d7-426a-91e4-1be1c8872ca8-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:31 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-85fafc4b-991d-425f-b6b8-c84282a84e34" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "cinder-quobyte-85fafc4b-991d-425f-b6b8-c84282a84e34" released by "delete_volume" :: held 0.756s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Created reservations ['c97461f5-2525-44df-8430-def3359d1b03', '434cefb5-bf62-4b29-81be-3024f07b8910', '270807c7-4ab1-4e6d-a06e-8b05ee705179', 'af63b586-cc48-4e70-a8b9-5e193bed2f16'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:32 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:32 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (6bb51454-d26e-4901-863b-39bbd7dede74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3bea9b-8f09-40e1-8254-feb4d2388d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3bea9b-8f09-40e1-8254-feb4d2388d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753121228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e1801b-9203-4626-89c4-aedf2f3cc797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:32Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996d5e4-4e12-472c-b388-a9b9a5f14d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3996d5e4-4e12-472c-b388-a9b9a5f14d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876b8468-4442-4fc7-a205-469a1723b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876b8468-4442-4fc7-a205-469a1723b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e1801b-9203-4626-89c4-aedf2f3cc797', 'volume_name': 'volume-48e1801b-9203-4626-89c4-aedf2f3cc797', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705d47b7-7864-4107-a5fb-de8f723fbf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705d47b7-7864-4107-a5fb-de8f723fbf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468ce036-b5f7-4a93-9a56-a286a5012064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:32 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Volume 48e1801b-9203-4626-89c4-aedf2f3cc797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e1801b-9203-4626-89c4-aedf2f3cc797', 'volume_size': 1} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753121228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e1801b-9203-4626-89c4-aedf2f3cc797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:32Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Creating volume 48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:32 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:32 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 1073741824 Sep 01 00:35:32 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:32 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.515s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:32 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Deleted volume successfully. Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-68a56bf6-f5e8-4825-830d-7105cc0b5f3e tempest-ProjectReaderTests-1481137753 None] Lock "cinder-85fafc4b-991d-425f-b6b8-c84282a84e34-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:32 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 1073741824" returned: 0 in 0.600s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:32 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 Sep 01 00:35:32 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Flow 'volume_create_manager' (e1eee745-08c0-49e2-9861-3d9228d995b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af28caf0-3daa-4185-9976-ca787dae524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af28caf0-3daa-4185-9976-ca787dae524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180642408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3383d9c-2e6b-483e-b96e-9fd7954338c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2eeb2fbcb140d48cc025d20fb64701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:33Z,use_quota=True,user_id='b93cbed890b6441bba64f0fca649ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0505bb58-14db-465e-a370-eae91645d493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0505bb58-14db-465e-a370-eae91645d493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a9d90-8f72-4624-b8c7-af0f27993ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd2a9d90-8f72-4624-b8c7-af0f27993ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3383d9c-2e6b-483e-b96e-9fd7954338c0', 'volume_name': 'volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b836d52e-2231-438b-8283-dee4159ce609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b836d52e-2231-438b-8283-dee4159ce609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a471a54-8070-4cc1-b4f3-3f0b9aea1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Volume e3383d9c-2e6b-483e-b96e-9fd7954338c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0', 'volume_size': 1} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:33 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.479s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468ce036-b5f7-4a93-9a56-a286a5012064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e1801b-9203-4626-89c4-aedf2f3cc797', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad860c8-db1e-4175-a09c-cacbfb88c04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 2abedf3a-14e2-4238-91f2-1ffad382cea1 of volume bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:33 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Volume volume-48e1801b-9203-4626-89c4-aedf2f3cc797 (48e1801b-9203-4626-89c4-aedf2f3cc797): created successfully Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad860c8-db1e-4175-a09c-cacbfb88c04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (6bb51454-d26e-4901-863b-39bbd7dede74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea84b6-8edc-49d5-a207-ce658865e4ba]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8f786579-d0a1-4f92-9de4-ed53a0aa6042 tempest-ProjectReaderTests-146138966 None] Created volume successfully. Sep 01 00:35:33 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 Sep 01 00:35:33 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:33 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528" returned: 0 in 0.428s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:33 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 1G Sep 01 00:35:33 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:34 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 1G" returned: 0 in 0.452s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:34 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 Sep 01 00:35:34 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:34 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1" returned: 0 in 0.311s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:34 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 is being set with open permissions: ugo+rw Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:34 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 Sep 01 00:35:34 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:34 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1" returned: 0 in 0.252s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:34 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info Sep 01 00:35:34 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:34 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info" returned: 0 in 0.244s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:34 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info is being set with open permissions: ugo+rw Sep 01 00:35:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:34 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info Sep 01 00:35:34 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:35 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.info" returned: 0 in 0.254s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180642408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3383d9c-2e6b-483e-b96e-9fd7954338c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2eeb2fbcb140d48cc025d20fb64701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:33Z,use_quota=True,user_id='b93cbed890b6441bba64f0fca649ac04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Creating volume e3383d9c-2e6b-483e-b96e-9fd7954338c0 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:35 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:35 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 1073741824 Sep 01 00:35:35 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5ac81def-f34a-4a95-827d-ef8d8b94d40c tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-2abedf3a-14e2-4238-91f2-1ffad382cea1-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-2abedf3a-14e2-4238-91f2-1ffad382cea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-2abedf3a-14e2-4238-91f2-1ffad382cea1" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-2abedf3a-14e2-4238-91f2-1ffad382cea1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 2abedf3a-14e2-4238-91f2-1ffad382cea1 of volume bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:35 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 1073741824" returned: 0 in 0.551s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8fe9df-ceed-49b8-83f6-f252267590b1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:35 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 Sep 01 00:35:35 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:35 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 Sep 01 00:35:35 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:36 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.438s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Creating offline snapshot 4bc9b2df-8f64-406e-b07d-fe42967a5054 of volume 48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a471a54-8070-4cc1-b4f3-3f0b9aea1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ab6f04-34b6-4e32-80e7-e0a22b327f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e83882-6f96-430f-ab9b-b6c3c99fb0b7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:36 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Volume volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 (e3383d9c-2e6b-483e-b96e-9fd7954338c0): created successfully Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ab6f04-34b6-4e32-80e7-e0a22b327f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Flow 'volume_create_manager' (e1eee745-08c0-49e2-9861-3d9228d995b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:36 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:36 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-f32f2612-1fa9-460b-bc71-c0b1b8bf4fa7 tempest-ProjectReaderTests-1481137753 None] Created volume successfully. Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1" returned: 0 in 0.438s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d74cd3-3124-4c4c-a895-9e1a7fd45abc]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:36 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 Sep 01 00:35:36 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:36 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 Sep 01 00:35:36 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:36 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797" returned: 0 in 0.455s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:36 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 1G Sep 01 00:35:36 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:36 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528" returned: 0 in 0.437s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:36 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 Sep 01 00:35:36 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:37 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 1G" returned: 0 in 0.497s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e1801b-9203-4626-89c4-aedf2f3cc797 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:37 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:37 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e1801b-9203-4626-89c4-aedf2f3cc797 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 Sep 01 00:35:37 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:37 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1 Sep 01 00:35:37 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Acquiring lock "cinder-e3383d9c-2e6b-483e-b96e-9fd7954338c0-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "cinder-e3383d9c-2e6b-483e-b96e-9fd7954338c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Acquiring lock "cinder-quobyte-e3383d9c-2e6b-483e-b96e-9fd7954338c0" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "cinder-quobyte-e3383d9c-2e6b-483e-b96e-9fd7954338c0" acquired by "delete_volume" :: waited 0.041s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:37 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528.2abedf3a-14e2-4238-91f2-1ffad382cea1" returned: 0 in 0.384s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[0993d0a1-cf59-4ae8-bdd4-efbd281c2260]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-2abedf3a-14e2-4238-91f2-1ffad382cea1" released by "_delete_snapshot" :: held 1.888s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" released by "delete_snapshot" :: held 1.923s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:37 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e1801b-9203-4626-89c4-aedf2f3cc797 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054" returned: 0 in 0.551s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:37 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 is being set with open permissions: ugo+rw Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:37 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 Sep 01 00:35:37 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:37 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 Sep 01 00:35:37 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Created reservations ['b283c704-7ef8-40f2-af37-6878806ee71e', '464b2e9a-6c32-4fc9-a574-2127b337d464', 'a9acbbfe-3b15-4b5d-8fc0-2f85ed156bca', '6a4efbc4-c2c7-4178-a713-3e06493b0a59'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-2f907546-5001-41b6-a7a1-df6bd7faf032 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-2abedf3a-14e2-4238-91f2-1ffad382cea1-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-bdb7f2f9-b0c3-4c64-919a-2b0584372528-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-bdb7f2f9-b0c3-4c64-919a-2b0584372528-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" acquired by "delete_volume" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:38 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c89f0d-34f0-46f9-9609-9918963a3732]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0" returned: 0 in 0.531s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0 Sep 01 00:35:38 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info Sep 01 00:35:38 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 Sep 01 00:35:38 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-e3383d9c-2e6b-483e-b96e-9fd7954338c0" returned: 0 in 0.314s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "cinder-quobyte-e3383d9c-2e6b-483e-b96e-9fd7954338c0" released by "delete_volume" :: held 0.917s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:38 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info" returned: 0 in 0.333s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info is being set with open permissions: ugo+rw Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info Sep 01 00:35:38 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528" returned: 0 in 0.477s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528 Sep 01 00:35:38 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Created reservations ['079c05c9-260e-410b-b522-c39a08eaa180', '526b1ff6-f829-4654-877d-66a6f3e01bf7', '19204227-edeb-4f9f-b56d-529eb18a3980', '90534b5d-b206-4c95-bbad-e30de2b3243e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:38 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.info" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:38 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:38 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5611c014-4df5-4916-be2b-81dfc524911f tempest-ProjectReaderTests-146138966 None] Create snapshot completed successfully Sep 01 00:35:38 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-bdb7f2f9-b0c3-4c64-919a-2b0584372528" returned: 0 in 0.297s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-bdb7f2f9-b0c3-4c64-919a-2b0584372528" released by "delete_volume" :: held 0.849s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:38 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Created reservations ['26f6c9b2-a8a3-452e-bfc0-91d310754952', 'b3c2c970-4fa3-4a11-bc18-40e862b3a749', '03374865-3139-40a4-a7a8-8f0764881cd3', 'b5caa2b8-ac0f-414a-9148-eea69aa016ae'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-4bc9b2df-8f64-406e-b07d-fe42967a5054-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-4bc9b2df-8f64-406e-b07d-fe42967a5054-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:39 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:39 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:39 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-4bc9b2df-8f64-406e-b07d-fe42967a5054" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Deleted volume successfully. Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4bc9b2df-8f64-406e-b07d-fe42967a5054" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Deleting offline snapshot 4bc9b2df-8f64-406e-b07d-fe42967a5054 of volume 48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] snapshot_file for this snap is: volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6d780aff-a409-4f12-9680-f9a5ca4bb39d tempest-ProjectReaderTests-1481137753 None] Lock "cinder-e3383d9c-2e6b-483e-b96e-9fd7954338c0-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[960050e3-1f08-4072-b71c-bbe479aff698]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:39 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 Sep 01 00:35:39 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.316s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-b129e484-aa84-4ff3-8b58-64bfac85d065 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-bdb7f2f9-b0c3-4c64-919a-2b0584372528-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:39 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054" returned: 0 in 0.503s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48e1801b-9203-4626-89c4-aedf2f3cc797(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[093419c2-092a-483c-b32b-3711d4c8f434]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (255b873a-0b11-4f25-9c9d-e3214d40b3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec360c1-7684-4897-870b-227332106bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec360c1-7684-4897-870b-227332106bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304580404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea896b85-39bc-41bb-8b8e-01218b7b8022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:40Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0e24b-c9b4-4d3d-bc10-a30193a72c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0e24b-c9b4-4d3d-bc10-a30193a72c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b978768-dbde-463c-b1ea-602551b9200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:39 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 Sep 01 00:35:39 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b978768-dbde-463c-b1ea-602551b9200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea896b85-39bc-41bb-8b8e-01218b7b8022', 'volume_name': 'volume-ea896b85-39bc-41bb-8b8e-01218b7b8022', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aee483a-216a-406e-843d-2c74890c73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aee483a-216a-406e-843d-2c74890c73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be818bb-b229-44cb-82d4-0defdeba7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:39 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Volume ea896b85-39bc-41bb-8b8e-01218b7b8022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea896b85-39bc-41bb-8b8e-01218b7b8022', 'volume_size': 1} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304580404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea896b85-39bc-41bb-8b8e-01218b7b8022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:40Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Creating volume ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:39 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:40 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 1073741824 Sep 01 00:35:40 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:40 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797" returned: 0 in 0.438s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:40 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 Sep 01 00:35:40 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:40 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 1073741824" returned: 0 in 0.612s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:40 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 Sep 01 00:35:40 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:40 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054" returned: 0 in 0.471s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:40 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054 Sep 01 00:35:40 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:40 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022" returned: 0 in 0.323s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be818bb-b229-44cb-82d4-0defdeba7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea896b85-39bc-41bb-8b8e-01218b7b8022', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:40 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848f329-cd9e-4d6e-933a-3570abc29724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Volume volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 (ea896b85-39bc-41bb-8b8e-01218b7b8022): created successfully Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848f329-cd9e-4d6e-933a-3570abc29724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (255b873a-0b11-4f25-9c9d-e3214d40b3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d68ff8c4-281a-46a4-a288-0e926727fd6c tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:35:41 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797.4bc9b2df-8f64-406e-b07d-fe42967a5054" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-4bc9b2df-8f64-406e-b07d-fe42967a5054" released by "_delete_snapshot" :: held 1.962s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" released by "delete_snapshot" :: held 2.019s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Created reservations ['0a438822-3d7b-48e2-b1a0-5a4126a80667', '36400f59-7703-407f-bfc5-2c1bf2c98bc1', '30722c24-1589-4421-9982-96a4e9549236', 'dbbdb3d0-bafd-4573-9a40-50b56328ebdd'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:41 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Delete snapshot completed successfully. Sep 01 00:35:41 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f64b7cb-8d47-47be-9faf-5e1f36f799c9 tempest-ProjectReaderTests-146138966 None] Lock "cinder-4bc9b2df-8f64-406e-b07d-fe42967a5054-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 4d6a4106-c092-4703-98e1-a93b731d7529 of volume ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-48e1801b-9203-4626-89c4-aedf2f3cc797-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5607f-0486-49ec-96de-1a6f1a11487a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "cinder-48e1801b-9203-4626-89c4-aedf2f3cc797-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:42 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 Sep 01 00:35:42 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe8115-4f6c-4d86-942e-1262fe649d89]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:42 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 Sep 01 00:35:42 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:42 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022" returned: 0 in 0.480s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:42 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 1G Sep 01 00:35:42 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:42 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797" returned: 0 in 0.496s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:43 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797 Sep 01 00:35:43 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:43 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-48e1801b-9203-4626-89c4-aedf2f3cc797" returned: 0 in 0.395s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:43 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 1G" returned: 0 in 0.640s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-48e1801b-9203-4626-89c4-aedf2f3cc797" released by "delete_volume" :: held 1.013s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:43 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 Sep 01 00:35:43 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Created reservations ['82d36c4e-eedc-4425-b3cf-cf07fc42041e', '3c1fe884-0491-411b-b9de-22b1bfc83d0c', 'ece03b0f-9b19-4bbe-9143-8a8347fc5d3f', 'aeb2d66b-cb3f-4726-bbdb-dceff2f2eab1'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:43 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:43 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:43 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:43 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 is being set with open permissions: ugo+rw Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:43 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 Sep 01 00:35:43 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:43 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.262s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:43 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Deleted volume successfully. Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4a015d7b-52fb-4a1c-adf6-ad518993e1d7 tempest-ProjectReaderTests-146138966 None] Lock "cinder-48e1801b-9203-4626-89c4-aedf2f3cc797-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:43 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529" returned: 0 in 0.264s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:44 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info Sep 01 00:35:44 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:44 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:44 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info is being set with open permissions: ugo+rw Sep 01 00:35:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:44 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info Sep 01 00:35:44 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:44 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.info" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-37e6c666-11a1-4221-9e77-24368b9007bc tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (485f929d-0584-4356-a41d-013149e88522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a6db95-840b-4445-97ca-548d3bd2c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a6db95-840b-4445-97ca-548d3bd2c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984993007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c001d7-0353-406c-870a-68e8911aa4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:45Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a631f-c99b-48bf-8001-4e59607e091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82a631f-c99b-48bf-8001-4e59607e091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7633750c-ff95-466f-9f01-1ceba71951b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7633750c-ff95-466f-9f01-1ceba71951b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c001d7-0353-406c-870a-68e8911aa4d2', 'volume_name': 'volume-96c001d7-0353-406c-870a-68e8911aa4d2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f4918a-c862-4a90-8a18-e4d78bb52f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f4918a-c862-4a90-8a18-e4d78bb52f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc5873-5a7a-4ca3-9a12-86eb18ccd553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:45 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Volume 96c001d7-0353-406c-870a-68e8911aa4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c001d7-0353-406c-870a-68e8911aa4d2', 'volume_size': 1} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984993007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c001d7-0353-406c-870a-68e8911aa4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:45Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Creating volume 96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:45 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:45 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 1073741824 Sep 01 00:35:45 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-4d6a4106-c092-4703-98e1-a93b731d7529-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-4d6a4106-c092-4703-98e1-a93b731d7529-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-4d6a4106-c092-4703-98e1-a93b731d7529" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-4d6a4106-c092-4703-98e1-a93b731d7529" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 4d6a4106-c092-4703-98e1-a93b731d7529 of volume ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d7b0b-fb5a-406c-aa92-b440ace4e23d]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:45 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 Sep 01 00:35:45 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:45 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 1073741824" returned: 0 in 0.606s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:45 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 Sep 01 00:35:45 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:45 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea896b85-39bc-41bb-8b8e-01218b7b8022(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe9cb1-565e-4953-914b-c88c43e87d79]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:46 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 Sep 01 00:35:46 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:46 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2" returned: 0 in 0.270s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc5873-5a7a-4ca3-9a12-86eb18ccd553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c001d7-0353-406c-870a-68e8911aa4d2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d807cc4-bd4a-434b-b1bf-517a53f79118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:46 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Volume volume-96c001d7-0353-406c-870a-68e8911aa4d2 (96c001d7-0353-406c-870a-68e8911aa4d2): created successfully Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d807cc4-bd4a-434b-b1bf-517a53f79118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (485f929d-0584-4356-a41d-013149e88522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d17278f2-bf1f-4f75-afb5-c730bf2c4073 tempest-ProjectReaderTests-146138966 None] Created volume successfully. Sep 01 00:35:46 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022" returned: 0 in 0.503s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:46 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 Sep 01 00:35:46 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:46 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:46 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529 Sep 01 00:35:46 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:47 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022.4d6a4106-c092-4703-98e1-a93b731d7529" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-4d6a4106-c092-4703-98e1-a93b731d7529" released by "_delete_snapshot" :: held 1.863s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" released by "delete_snapshot" :: held 1.907s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Created reservations ['068231a7-1785-46c3-abb5-1008584f7b60', 'c5431756-36d3-4c7d-8a85-00ee0ce3be9f', '6ce2d429-622e-4018-aa26-ab8204d5544f', '16220794-1b40-4909-8667-4a472eb6725b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Creating offline snapshot fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c of volume 96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-86e9512a-0d6a-41a9-b2e4-5dfe38799045 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-4d6a4106-c092-4703-98e1-a93b731d7529-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[42539dd4-9b26-4d4f-ba44-bd96d5b2ba48]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-ea896b85-39bc-41bb-8b8e-01218b7b8022-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-ea896b85-39bc-41bb-8b8e-01218b7b8022-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:47 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 Sep 01 00:35:47 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b6b82-b583-4675-92d0-a3261b7aa3d1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:48 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 Sep 01 00:35:48 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:48 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2" returned: 0 in 0.500s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:48 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c 1G Sep 01 00:35:48 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:48 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022" returned: 0 in 0.525s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:48 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022 Sep 01 00:35:48 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:48 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c 1G" returned: 0 in 0.526s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c001d7-0353-406c-870a-68e8911aa4d2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:48 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c001d7-0353-406c-870a-68e8911aa4d2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c Sep 01 00:35:48 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:48 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ea896b85-39bc-41bb-8b8e-01218b7b8022" returned: 0 in 0.337s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:48 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-ea896b85-39bc-41bb-8b8e-01218b7b8022" released by "delete_volume" :: held 1.017s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Created reservations ['ef960fa9-c1fa-4c4a-b99b-e5070f6b0122', 'b15fef36-393d-42d7-9058-1dff1f288080', '1eb7af04-6fbd-4692-a8c9-e7638f92f9e5', 'fc683227-37d9-49c9-a482-f54141fbfc43'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:49 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:49 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:49 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c001d7-0353-406c-870a-68e8911aa4d2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" returned: 0 in 0.450s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:49 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c is being set with open permissions: ugo+rw Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:49 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c Sep 01 00:35:49 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:49 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:49 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:35:49 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" returned: 0 in 0.279s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a8c7824b-5c34-4269-833e-741256a89fd5 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-ea896b85-39bc-41bb-8b8e-01218b7b8022-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:49 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info Sep 01 00:35:49 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:49 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:49 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info is being set with open permissions: ugo+rw Sep 01 00:35:49 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:49 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info Sep 01 00:35:49 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:50 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.info" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:50 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-5578e051-b911-4d48-9dac-9e776fd39182 tempest-ProjectReaderTests-146138966 None] Create snapshot completed successfully Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (31ff66f4-bfdb-4bda-9b3e-16af5ad3bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50065a-aec7-48ea-a36a-29cf82039fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50065a-aec7-48ea-a36a-29cf82039fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836210769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287f99b5-a832-45fd-97c6-857e9dfa63e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:51Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0831bb-f076-4297-a7a4-c36c6e64453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0831bb-f076-4297-a7a4-c36c6e64453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336280e0-cf26-4071-95f4-a88e066734b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336280e0-cf26-4071-95f4-a88e066734b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287f99b5-a832-45fd-97c6-857e9dfa63e2', 'volume_name': 'volume-287f99b5-a832-45fd-97c6-857e9dfa63e2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086e088-0e76-4084-921b-a3b74bb12db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0086e088-0e76-4084-921b-a3b74bb12db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f801048-c756-4746-88ac-3e200b9d42c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:50 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Volume 287f99b5-a832-45fd-97c6-857e9dfa63e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287f99b5-a832-45fd-97c6-857e9dfa63e2', 'volume_size': 1} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836210769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287f99b5-a832-45fd-97c6-857e9dfa63e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:51Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Creating volume 287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:50 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:50 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 1073741824 Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:50 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Deleting offline snapshot fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c of volume 96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] snapshot_file for this snap is: volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145d89d-5e16-4c9a-929d-3d00ea4e8fc3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:50 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:50 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c Sep 01 00:35:50 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:51 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" returned: 0 in 0.422s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96c001d7-0353-406c-870a-68e8911aa4d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[08886352-d908-4d4d-b9ff-a862a9f15489]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:51 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 1073741824" returned: 0 in 0.598s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:51 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 Sep 01 00:35:51 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:51 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 Sep 01 00:35:51 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:51 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2" returned: 0 in 0.320s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f801048-c756-4746-88ac-3e200b9d42c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287f99b5-a832-45fd-97c6-857e9dfa63e2', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12940127-a8b8-4171-b780-4bfc86492c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:51 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Volume volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 (287f99b5-a832-45fd-97c6-857e9dfa63e2): created successfully Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12940127-a8b8-4171-b780-4bfc86492c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (31ff66f4-bfdb-4bda-9b3e-16af5ad3bc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:51 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-791638cd-d5bf-4c79-ac7b-64e9d8f3bfa7 tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:35:51 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2" returned: 0 in 0.456s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:51 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:51 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c Sep 01 00:35:51 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:52 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" returned: 0 in 0.387s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:52 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c Sep 01 00:35:52 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:52 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2.fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" returned: 0 in 0.266s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c" released by "_delete_snapshot" :: held 1.652s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" released by "delete_snapshot" :: held 1.676s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Created reservations ['d5fb1963-db2f-42e3-b2a9-e21f46280e9e', 'c123e541-8f51-4523-88fa-9923a0add455', '2762c461-05f6-45a8-9683-2fbb20b17f5c', '3f6c45ff-1cc6-4ab6-81fd-ae3fd435439b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:52 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Delete snapshot completed successfully. Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-cf794e79-8d45-45f7-81a7-12660439c57a tempest-ProjectReaderTests-146138966 None] Lock "cinder-fd5c8ff7-59b9-4ae6-99f5-4e4663ad555c-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot b935fb4f-3b9d-45e7-bc01-0fa6c202933e of volume 287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-96c001d7-0353-406c-870a-68e8911aa4d2-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df363d-1ab0-4a6b-aafa-85ec9b6aae72]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:52 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "cinder-96c001d7-0353-406c-870a-68e8911aa4d2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290e684-1628-4d75-83eb-ebfa24cb9454]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:53 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 Sep 01 00:35:53 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:53 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 Sep 01 00:35:53 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:53 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2" returned: 0 in 0.464s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:53 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e 1G Sep 01 00:35:53 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:53 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2" returned: 0 in 0.433s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:53 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2 Sep 01 00:35:53 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:53 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-96c001d7-0353-406c-870a-68e8911aa4d2" returned: 0 in 0.310s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-96c001d7-0353-406c-870a-68e8911aa4d2" released by "delete_volume" :: held 0.810s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Created reservations ['41a5e29d-e42a-4eed-868b-e47276750dd9', 'd4eab89a-161c-4594-89f5-471d90ec0a5e', 'bb54ed99-bdaa-4e7d-bdef-3831dc816f1c', '2a8aaa7a-2029-4858-8d47-0f702865b0dd'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:53 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e 1G" returned: 0 in 0.566s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:53 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:54 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e Sep 01 00:35:54 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:54 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:54 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:54 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.318s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:54 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e" returned: 0 in 0.390s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:54 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e is being set with open permissions: ugo+rw Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:54 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Deleted volume successfully. Sep 01 00:35:54 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e Sep 01 00:35:54 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-fb2d7513-28aa-4e3c-a010-cab1fc95c1dc tempest-ProjectReaderTests-146138966 None] Lock "cinder-96c001d7-0353-406c-870a-68e8911aa4d2-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:54 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e" returned: 0 in 0.319s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:54 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info Sep 01 00:35:54 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (6cb51cf5-f999-422e-983e-a8de3dde810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7f7ef1-ad25-46a7-87f9-9dc6864ebfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7f7ef1-ad25-46a7-87f9-9dc6864ebfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493638116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6602ac2-f205-4ac5-bc41-e30b45d6723e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:55Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bec06f-66dc-48b4-a5f5-c08d04255182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bec06f-66dc-48b4-a5f5-c08d04255182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a397ab-a98e-4a46-b176-b477427cade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a397ab-a98e-4a46-b176-b477427cade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6602ac2-f205-4ac5-bc41-e30b45d6723e', 'volume_name': 'volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e7de1a-c002-4a62-abad-ae0695ea429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e7de1a-c002-4a62-abad-ae0695ea429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3977093f-a2d4-479b-a5d1-2aef469c5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:54 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Volume f6602ac2-f205-4ac5-bc41-e30b45d6723e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e', 'volume_size': 1} Sep 01 00:35:54 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:55 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:55 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info is being set with open permissions: ugo+rw Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:55 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info Sep 01 00:35:55 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:55 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.info" returned: 0 in 0.269s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493638116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6602ac2-f205-4ac5-bc41-e30b45d6723e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5145191c4c2d4dac9b9085f4d84c539e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:35:55Z,use_quota=True,user_id='d1a4541ec41d444a9647ee83a0ccd33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Creating volume f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:35:55 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:55 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e 1073741824 Sep 01 00:35:55 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:55 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3170f6ea-7662-4970-9eae-8a7d26bf22d4 tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:35:55 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e 1073741824" returned: 0 in 0.479s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:55 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:55 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e Sep 01 00:35:55 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:56 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3977093f-a2d4-479b-a5d1-2aef469c5afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30088e9-b359-4998-a131-15b4bf24e628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-b935fb4f-3b9d-45e7-bc01-0fa6c202933e-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:56 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Volume volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e (f6602ac2-f205-4ac5-bc41-e30b45d6723e): created successfully Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30088e9-b359-4998-a131-15b4bf24e628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Flow 'volume_create_manager' (6cb51cf5-f999-422e-983e-a8de3dde810f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-b935fb4f-3b9d-45e7-bc01-0fa6c202933e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:56 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b042bd33-e76e-41e4-9aff-ac0129e8823f tempest-ProjectReaderTests-146138966 None] Created volume successfully. Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-b935fb4f-3b9d-45e7-bc01-0fa6c202933e" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-b935fb4f-3b9d-45e7-bc01-0fa6c202933e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot b935fb4f-3b9d-45e7-bc01-0fa6c202933e of volume 287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee273f30-83fb-4094-81d2-2e370de79b3a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:56 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e Sep 01 00:35:56 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:56 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-287f99b5-a832-45fd-97c6-857e9dfa63e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2683a8-7f1c-40e0-a2d5-377a6c556b42]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:56 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:56 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 Sep 01 00:35:56 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Creating offline snapshot d9279a60-e6a2-48a2-be25-5f74fe4b6b23 of volume f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf0d448-efda-480d-805e-07426bcbcc83]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:57 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2" returned: 0 in 0.411s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:57 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e Sep 01 00:35:57 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:57 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e Sep 01 00:35:57 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:57 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:57 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 1G Sep 01 00:35:57 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:57 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e" returned: 0 in 0.449s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:57 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e Sep 01 00:35:57 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:57 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2.b935fb4f-3b9d-45e7-bc01-0fa6c202933e" returned: 0 in 0.289s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-b935fb4f-3b9d-45e7-bc01-0fa6c202933e" released by "_delete_snapshot" :: held 1.718s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:57 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" released by "delete_snapshot" :: held 1.750s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Created reservations ['128ec3b2-ba59-4212-aa77-4f2edc599b72', '45042d0a-2450-42e8-a1a5-1e6435fd3e69', '2c98329b-e6b7-47cd-bce7-d4b41245e252', '522bfba3-c4b4-4e4a-a8fc-4ba85817b7ee'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:58 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 1G" returned: 0 in 0.523s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:58 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 Sep 01 00:35:58 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:58 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-4632fb2d-9890-4c27-be5a-e0fa83ab0955 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-b935fb4f-3b9d-45e7-bc01-0fa6c202933e-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-287f99b5-a832-45fd-97c6-857e9dfa63e2-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "cinder-287f99b5-a832-45fd-97c6-857e9dfa63e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:35:58 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23" returned: 0 in 0.414s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:58 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 is being set with open permissions: ugo+rw Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ff330c-bd06-4c3f-9486-2952d82b1b7a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:58 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 Sep 01 00:35:58 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:58 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 Sep 01 00:35:58 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:58 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:58 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info Sep 01 00:35:58 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:58 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2" returned: 0 in 0.453s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:58 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:58 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2 Sep 01 00:35:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:59 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info" returned: 0 in 0.317s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:59 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info is being set with open permissions: ugo+rw Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:59 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info Sep 01 00:35:59 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:59 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-287f99b5-a832-45fd-97c6-857e9dfa63e2" returned: 0 in 0.286s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-287f99b5-a832-45fd-97c6-857e9dfa63e2" released by "delete_volume" :: held 0.816s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Created reservations ['c26a26f0-d095-4f59-82c8-195ef64f78e9', 'a81d3837-d1e2-48ac-b5b6-3cc0c0098306', 'f0b65ed6-ece2-40ac-8b0d-f1e4cb4bc769', '85355410-3745-4aec-8cbb-32dafb2d309e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:35:59 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:59 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.info" returned: 0 in 0.342s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:59 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:35:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-135327c9-2d58-4282-84fc-9d6e2d843fa8 tempest-ProjectReaderTests-146138966 None] Create snapshot completed successfully Sep 01 00:35:59 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.307s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:35:59 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:35:59 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-140ee571-780f-4ffc-9ca0-a5c3d1169abf tempest-ProjectMemberTests-1194111758 None] Lock "cinder-287f99b5-a832-45fd-97c6-857e9dfa63e2-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (46d0f754-7ffc-461b-8978-d7fece934e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d6b628-0ad9-424b-92a9-90354e5605ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d6b628-0ad9-424b-92a9-90354e5605ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815121264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b91f4c3-49c6-4854-8a0c-7307eb70f08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:00Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546cb4bd-2469-40b2-95f9-ada5916eea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546cb4bd-2469-40b2-95f9-ada5916eea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe266a93-9ac6-4be4-a03d-90e40675cc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe266a93-9ac6-4be4-a03d-90e40675cc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b91f4c3-49c6-4854-8a0c-7307eb70f08d', 'volume_name': 'volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22521a67-0f97-4a16-af14-d509f7f7c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22521a67-0f97-4a16-af14-d509f7f7c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b858c25-eac5-4a2a-9cd5-b8345c81f015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:00 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Volume 8b91f4c3-49c6-4854-8a0c-7307eb70f08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d', 'volume_size': 1} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815121264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b91f4c3-49c6-4854-8a0c-7307eb70f08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:00Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Creating volume 8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:00 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-d9279a60-e6a2-48a2-be25-5f74fe4b6b23-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:00 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d 1073741824 Sep 01 00:36:00 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-d9279a60-e6a2-48a2-be25-5f74fe4b6b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-d9279a60-e6a2-48a2-be25-5f74fe4b6b23" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-d9279a60-e6a2-48a2-be25-5f74fe4b6b23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Deleting offline snapshot d9279a60-e6a2-48a2-be25-5f74fe4b6b23 of volume f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] snapshot_file for this snap is: volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[5127080e-9465-4263-ab87-3ff0cf32f9c1]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:00 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 Sep 01 00:36:00 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:00 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d 1073741824" returned: 0 in 0.474s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:00 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23" returned: 0 in 0.413s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:00 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d Sep 01 00:36:00 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8528b08e-214d-433e-95f4-d1e831237f25]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:00 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:00 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e Sep 01 00:36:00 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:01 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b858c25-eac5-4a2a-9cd5-b8345c81f015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbee2e8-1ed8-41f4-bb45-2c0b983717f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:01 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Volume volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d (8b91f4c3-49c6-4854-8a0c-7307eb70f08d): created successfully Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbee2e8-1ed8-41f4-bb45-2c0b983717f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (46d0f754-7ffc-461b-8978-d7fece934e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:01 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9b2e73f0-a48f-46fe-b0d9-0f92f77b71ae tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:01 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e" returned: 0 in 0.429s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:01 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 Sep 01 00:36:01 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:01 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:01 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23 Sep 01 00:36:01 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:01 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e.d9279a60-e6a2-48a2-be25-5f74fe4b6b23" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-d9279a60-e6a2-48a2-be25-5f74fe4b6b23" released by "_delete_snapshot" :: held 1.605s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:01 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" released by "delete_snapshot" :: held 1.631s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (60ea8142-c04d-4e48-9381-523afff45e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a3e6e-a56b-4e81-80f4-890d88d2799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Created reservations ['f94ad6f9-f8f2-43e1-aa5d-65391438efff', 'aa638b63-a77c-45b8-9192-8da68e7d2037', '69927645-c9df-425d-901c-cade91eb61c1', 'd5f82605-609a-4520-99a9-9f4a6e07b827'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670a3e6e-a56b-4e81-80f4-890d88d2799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189108565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d261f86c-426b-46da-87f5-073f737a0231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:02Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5eed5e-f112-4579-a693-2b2787a018b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5eed5e-f112-4579-a693-2b2787a018b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80214664-841c-4cd8-b2a4-3c82b11bc018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80214664-841c-4cd8-b2a4-3c82b11bc018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd261f86c-426b-46da-87f5-073f737a0231', 'volume_name': 'volume-d261f86c-426b-46da-87f5-073f737a0231', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb9b16a-028d-4d18-8c74-4c169323e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb9b16a-028d-4d18-8c74-4c169323e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28f51ee-2243-4230-af47-c3eba0c3859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:02 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Volume d261f86c-426b-46da-87f5-073f737a0231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d261f86c-426b-46da-87f5-073f737a0231', 'volume_size': 1} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189108565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d261f86c-426b-46da-87f5-073f737a0231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:02Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Creating volume d261f86c-426b-46da-87f5-073f737a0231 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:02 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:02 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 1073741824 Sep 01 00:36:02 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:02 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Delete snapshot completed successfully. Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8b2cf441-0365-4198-9a91-392ee799b673 tempest-ProjectReaderTests-146138966 None] Lock "cinder-d9279a60-e6a2-48a2-be25-5f74fe4b6b23-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-f6602ac2-f205-4ac5-bc41-e30b45d6723e-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "cinder-f6602ac2-f205-4ac5-bc41-e30b45d6723e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Acquiring lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" acquired by "delete_volume" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e07b9e-73d0-4554-9329-3469beb0856c]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:02 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 1073741824" returned: 0 in 0.566s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:02 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e Sep 01 00:36:02 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:02 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 Sep 01 00:36:02 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:02 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e" returned: 0 in 0.389s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:02 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:03 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e Sep 01 00:36:03 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:03 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231" returned: 0 in 0.303s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.595s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 1d08f8b5-f1de-4502-b6cd-cc6f3998d57d of volume 8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28f51ee-2243-4230-af47-c3eba0c3859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d261f86c-426b-46da-87f5-073f737a0231', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42155ded-5675-4bf7-9e56-afbc1ee0cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a3a6be-5c13-4a03-9bd0-91f07dcf7ff5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:03 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Volume volume-d261f86c-426b-46da-87f5-073f737a0231 (d261f86c-426b-46da-87f5-073f737a0231): created successfully Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42155ded-5675-4bf7-9e56-afbc1ee0cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (60ea8142-c04d-4e48-9381-523afff45e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-2df4322c-6549-43f3-8212-f1f855d03709 tempest-ProjectReaderTests-888394594 None] Created volume successfully. Sep 01 00:36:03 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d Sep 01 00:36:03 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:03 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-f6602ac2-f205-4ac5-bc41-e30b45d6723e" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "cinder-quobyte-f6602ac2-f205-4ac5-bc41-e30b45d6723e" released by "delete_volume" :: held 0.720s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Created reservations ['7a97a7ed-4c1b-4aa5-9418-f4cacfb636e6', '9bb7dc01-1300-4183-87a4-58723f3edd7c', '1cd438be-42eb-450b-abae-3af0eda0292c', 'ad28b05c-3ceb-4e22-9c4c-01265d9f02b4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:03 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:03 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:03 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" returned: 0 in 0.408s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:03 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d 1G Sep 01 00:36:03 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:03 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.287s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:03 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Deleted volume successfully. Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-482b92d4-e527-40fd-8b0a-05f9b62d18ed tempest-ProjectReaderTests-146138966 None] Lock "cinder-f6602ac2-f205-4ac5-bc41-e30b45d6723e-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:03 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d 1G" returned: 0 in 0.458s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:03 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:03 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d Sep 01 00:36:03 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:04 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" returned: 0 in 0.347s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d is being set with open permissions: ugo+rw Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:04 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d Sep 01 00:36:04 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-d261f86c-426b-46da-87f5-073f737a0231-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "cinder-d261f86c-426b-46da-87f5-073f737a0231-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-quobyte-d261f86c-426b-46da-87f5-073f737a0231" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-d261f86c-426b-46da-87f5-073f737a0231" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a588212-594c-422a-b0bb-77402434ab30]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:04 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" returned: 0 in 0.306s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:04 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info Sep 01 00:36:04 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:04 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 Sep 01 00:36:04 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:04 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:04 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info is being set with open permissions: ugo+rw Sep 01 00:36:04 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:04 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info Sep 01 00:36:04 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:05 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231" returned: 0 in 0.487s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:05 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231 Sep 01 00:36:05 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:05 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.info" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:05 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7ad36a20-b3c0-46e0-a904-8eae8399f48d tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:05 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-d261f86c-426b-46da-87f5-073f737a0231" returned: 0 in 0.309s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-d261f86c-426b-46da-87f5-073f737a0231" released by "delete_volume" :: held 0.850s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Created reservations ['9adafb97-2a4a-488c-9041-04e3a27e5eaf', '9f6ea667-c491-437f-b74f-23895097890f', 'aa95a03c-918b-432c-9124-32e05882dc64', '8038db74-d08a-4c12-abc3-caea431b2d69'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:05 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:05 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 1d08f8b5-f1de-4502-b6cd-cc6f3998d57d of volume 8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[21abfd2a-135f-478a-b830-d10a0a12a961]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:05 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:06 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:06 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Deleted volume successfully. Sep 01 00:36:06 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d Sep 01 00:36:06 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-21288a37-c511-427f-a767-8469437d3939 tempest-ProjectReaderTests-888394594 None] Lock "cinder-d261f86c-426b-46da-87f5-073f737a0231-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (62a08c39-5386-4224-9d79-2191a9480d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dcab85-f13a-46dc-9cfd-91814cf358fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dcab85-f13a-46dc-9cfd-91814cf358fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595388415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fa0997-f8dc-42ed-84d0-b47cd02802f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:06Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64c216f-4240-4873-8bf3-6caf356ad685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64c216f-4240-4873-8bf3-6caf356ad685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57aca93-38cc-4f49-b718-6f741a734e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:06 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57aca93-38cc-4f49-b718-6f741a734e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52fa0997-f8dc-42ed-84d0-b47cd02802f4', 'volume_name': 'volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ac3c84-8e33-4d92-9a81-386496e83c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ac3c84-8e33-4d92-9a81-386496e83c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7009252a-fa02-49eb-bbfc-6726ac323ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:06 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Volume 52fa0997-f8dc-42ed-84d0-b47cd02802f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4', 'volume_size': 1} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1595388415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52fa0997-f8dc-42ed-84d0-b47cd02802f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:06Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Creating volume 52fa0997-f8dc-42ed-84d0-b47cd02802f4 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:06 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" returned: 0 in 0.537s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:06 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 1073741824 Sep 01 00:36:06 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f64a9-891f-4a47-9a6e-059ce32da075]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:06 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d Sep 01 00:36:06 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:06 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 1073741824" returned: 0 in 0.439s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:06 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" returned: 0 in 0.432s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:06 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:06 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 Sep 01 00:36:06 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:06 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d Sep 01 00:36:06 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:07 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7009252a-fa02-49eb-bbfc-6726ac323ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf65afbb-4cd6-485e-9964-90a93dd017f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:07 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Volume volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 (52fa0997-f8dc-42ed-84d0-b47cd02802f4): created successfully Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf65afbb-4cd6-485e-9964-90a93dd017f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (62a08c39-5386-4224-9d79-2191a9480d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b7bd93e6-4ceb-4e5b-a9bd-ea059fe6201a tempest-ProjectReaderTests-888394594 None] Created volume successfully. Sep 01 00:36:07 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" returned: 0 in 0.378s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:07 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d Sep 01 00:36:07 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:07 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d.1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d" released by "_delete_snapshot" :: held 1.740s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" released by "delete_snapshot" :: held 1.785s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Created reservations ['66a1f524-379f-425e-a368-18d27652fcaa', '6df488b7-ecf2-43cd-9255-9c83f53e10b3', 'bb202a75-4f41-4eb4-bf0e-3a37c3bbb3ae', '110c858e-d653-4017-b9ad-9316dbc30691'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:07 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-952fffdf-84aa-4eb8-9841-44640ce5f01b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-1d08f8b5-f1de-4502-b6cd-cc6f3998d57d-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-8b91f4c3-49c6-4854-8a0c-7307eb70f08d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-8b91f4c3-49c6-4854-8a0c-7307eb70f08d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:07 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" acquired by "delete_volume" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c02dd-e125-49d7-8d15-85ca59734367]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:08 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d Sep 01 00:36:08 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:08 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" returned: 0 in 0.379s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:08 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d Sep 01 00:36:08 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-52fa0997-f8dc-42ed-84d0-b47cd02802f4-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "cinder-52fa0997-f8dc-42ed-84d0-b47cd02802f4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-quobyte-52fa0997-f8dc-42ed-84d0-b47cd02802f4" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-52fa0997-f8dc-42ed-84d0-b47cd02802f4" acquired by "delete_volume" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a52b88-e257-40ea-a11b-857d61d7adbe]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:08 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" returned: 0 in 0.271s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:08 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 Sep 01 00:36:08 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-8b91f4c3-49c6-4854-8a0c-7307eb70f08d" released by "delete_volume" :: held 0.709s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Created reservations ['09355238-58f3-42bf-a932-f815d3da3f9b', '66d75cc5-3595-42a6-8855-ed419cb0b815', '722073e8-99e6-4c74-9248-32ee179016ce', 'd95ea4fa-1696-4450-b6f1-6169d4bcce8a'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:08 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:08 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:08 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:08 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:08 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4 Sep 01 00:36:08 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:09 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-427c4c5e-6dec-41e0-bee1-a2d89cbb5d99 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-8b91f4c3-49c6-4854-8a0c-7307eb70f08d-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:09 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-52fa0997-f8dc-42ed-84d0-b47cd02802f4" returned: 0 in 0.267s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-52fa0997-f8dc-42ed-84d0-b47cd02802f4" released by "delete_volume" :: held 0.682s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Created reservations ['441c7be3-eb81-40e0-88e5-0a50c9b15a85', '0d1d2d49-3eab-494e-9ea1-ef714259164b', '08e42d95-0825-4fb5-a2bc-33b8051923ea', 'c5026dcf-c585-42b6-8d41-1e9322a66fd4'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:09 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:09 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (25b98987-0bc0-49cd-9c73-8c58f9969620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e490309-5c97-4424-831d-1533e2882639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e490309-5c97-4424-831d-1533e2882639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388539392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11566fca-15f3-44d1-b749-2ead55674f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:10Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e027395-8471-4ae9-a91b-bf9c4f79670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e027395-8471-4ae9-a91b-bf9c4f79670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555b6776-1ec1-428b-80ef-149c107ceaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555b6776-1ec1-428b-80ef-149c107ceaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11566fca-15f3-44d1-b749-2ead55674f9b', 'volume_name': 'volume-11566fca-15f3-44d1-b749-2ead55674f9b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c486fc61-b2f1-4369-a73e-cf823513d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c486fc61-b2f1-4369-a73e-cf823513d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92b19f0-f78b-43ed-a2c0-279a0a8ad755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:09 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Volume 11566fca-15f3-44d1-b749-2ead55674f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11566fca-15f3-44d1-b749-2ead55674f9b', 'volume_size': 1} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388539392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11566fca-15f3-44d1-b749-2ead55674f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:10Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Creating volume 11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:09 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:09 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.343s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:09 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Deleted volume successfully. Sep 01 00:36:09 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b 1073741824 Sep 01 00:36:09 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:09 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-3f1977f7-e5ea-4acd-96be-335d82f508b3 tempest-ProjectReaderTests-888394594 None] Lock "cinder-52fa0997-f8dc-42ed-84d0-b47cd02802f4-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:10 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (69f46938-01fe-42dd-9f47-7f48abe230bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ee8f7-a17f-4119-997d-e1ba191e782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b 1073741824" returned: 0 in 0.498s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ee8f7-a17f-4119-997d-e1ba191e782b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713227923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f7ccd7-3033-4c61-a9bb-72170fb53a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:10Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01d601-8351-4c8f-96c5-460dad56bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e01d601-8351-4c8f-96c5-460dad56bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1e7f5f-2134-4cfa-9b11-1767be45d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1e7f5f-2134-4cfa-9b11-1767be45d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f7ccd7-3033-4c61-a9bb-72170fb53a35', 'volume_name': 'volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d40ece-c4d1-4307-bb99-b977f5743ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d40ece-c4d1-4307-bb99-b977f5743ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0ec62-b7a0-4338-9864-ea89aba50366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Volume 36f7ccd7-3033-4c61-a9bb-72170fb53a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35', 'volume_size': 1} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:10 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b Sep 01 00:36:10 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:10 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b" returned: 0 in 0.257s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1713227923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f7ccd7-3033-4c61-a9bb-72170fb53a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:10Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Creating volume 36f7ccd7-3033-4c61-a9bb-72170fb53a35 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:10 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92b19f0-f78b-43ed-a2c0-279a0a8ad755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11566fca-15f3-44d1-b749-2ead55674f9b', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 1073741824 Sep 01 00:36:10 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c8ff13-3f15-4a80-bd2f-27cb51a9a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:10 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Volume volume-11566fca-15f3-44d1-b749-2ead55674f9b (11566fca-15f3-44d1-b749-2ead55674f9b): created successfully Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c8ff13-3f15-4a80-bd2f-27cb51a9a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (25b98987-0bc0-49cd-9c73-8c58f9969620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:10 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0ea903c1-8408-4db0-acbf-6d925ac8d7fe tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:10 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:10 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 1073741824" returned: 0 in 0.410s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:11 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 Sep 01 00:36:11 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:11 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35" returned: 0 in 0.251s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0ec62-b7a0-4338-9864-ea89aba50366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ad07b9-d93a-4c08-9d32-c26d54d4d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:11 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Volume volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 (36f7ccd7-3033-4c61-a9bb-72170fb53a35): created successfully Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ad07b9-d93a-4c08-9d32-c26d54d4d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (69f46938-01fe-42dd-9f47-7f48abe230bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:11 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-1c8ebf09-6741-419b-af88-b1112b55e894 tempest-ProjectReaderTests-888394594 None] Created volume successfully. Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 9d2d87d4-0130-42b1-afdf-0f1b141f666c of volume 11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453cc22-e8d2-4618-95f8-003dc88b077b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:11 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b Sep 01 00:36:11 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:12 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b" returned: 0 in 0.370s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:12 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c 1G Sep 01 00:36:12 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-36f7ccd7-3033-4c61-a9bb-72170fb53a35-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "cinder-36f7ccd7-3033-4c61-a9bb-72170fb53a35-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-quobyte-36f7ccd7-3033-4c61-a9bb-72170fb53a35" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-36f7ccd7-3033-4c61-a9bb-72170fb53a35" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6205e-26d1-4a68-ba72-24f8df03df11]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:12 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 Sep 01 00:36:12 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:12 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c 1G" returned: 0 in 0.434s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11566fca-15f3-44d1-b749-2ead55674f9b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:12 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11566fca-15f3-44d1-b749-2ead55674f9b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c Sep 01 00:36:12 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:12 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35" returned: 0 in 0.420s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:12 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35 Sep 01 00:36:12 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:12 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11566fca-15f3-44d1-b749-2ead55674f9b -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c" returned: 0 in 0.314s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:12 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c is being set with open permissions: ugo+rw Sep 01 00:36:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:12 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c Sep 01 00:36:12 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:13 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-36f7ccd7-3033-4c61-a9bb-72170fb53a35" returned: 0 in 0.263s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-36f7ccd7-3033-4c61-a9bb-72170fb53a35" released by "delete_volume" :: held 0.732s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Created reservations ['370b148f-51c4-416f-af87-bcfefe5632b8', 'f89873a2-6bb3-4f2b-9645-ae4dfc2b2adc', '4cfda5ed-64e0-4c5c-9ae9-0254c10fac96', 'a868d0f4-4bf9-465b-8091-d8019b3df044'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:13 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:13 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:13 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info Sep 01 00:36:13 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:13 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.276s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Deleted volume successfully. Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-32c8d293-d9b0-4cb4-b69b-d1099f70d528 tempest-ProjectReaderTests-888394594 None] Lock "cinder-36f7ccd7-3033-4c61-a9bb-72170fb53a35-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:13 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info" returned: 0 in 0.293s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info is being set with open permissions: ugo+rw Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:13 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info Sep 01 00:36:13 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:13 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:13 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:13 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.301s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.info" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:36:13 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-3610ceb7-bdd8-43fe-8577-2d0221eb8cc2 tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:13 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (deae4102-e1c2-43a0-9192-2305c61e114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e717f5-87aa-49b9-be84-dd4dd867d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e717f5-87aa-49b9-be84-dd4dd867d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987304198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:14Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c55454-8960-4723-97dc-874306df1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c55454-8960-4723-97dc-874306df1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08a7934-9001-406e-aa1f-ab78ca31c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08a7934-9001-406e-aa1f-ab78ca31c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c', 'volume_name': 'volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f667ab3-8ba9-43b3-a4dd-3db3ad3e213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f667ab3-8ba9-43b3-a4dd-3db3ad3e213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ccd74f-d885-439b-9e6e-a402434a4d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Volume ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c', 'volume_size': 1} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1987304198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec3ab99db5e42af84839790303861d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:14Z,use_quota=True,user_id='f4637de12fe749bea894d0618ef747e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Creating volume ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:14 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:14 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c 1073741824 Sep 01 00:36:14 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:14 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c 1073741824" returned: 0 in 0.425s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:14 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c Sep 01 00:36:14 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:14 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" returned: 0 in 0.239s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ccd74f-d885-439b-9e6e-a402434a4d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff2cde8-73df-4b35-a0ce-99279e40cd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:14 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Volume volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c (ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c): created successfully Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff2cde8-73df-4b35-a0ce-99279e40cd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Flow 'volume_create_manager' (deae4102-e1c2-43a0-9192-2305c61e114c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:14 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-548e7361-5310-42b0-ad4d-49078cce0c66 tempest-ProjectReaderTests-888394594 None] Created volume successfully. Sep 01 00:36:14 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-9d2d87d4-0130-42b1-afdf-0f1b141f666c-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-9d2d87d4-0130-42b1-afdf-0f1b141f666c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-9d2d87d4-0130-42b1-afdf-0f1b141f666c" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "cinder-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-9d2d87d4-0130-42b1-afdf-0f1b141f666c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 9d2d87d4-0130-42b1-afdf-0f1b141f666c of volume 11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b225a-959a-4295-9766-f40632e9bc7a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Acquiring lock "cinder-quobyte-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" acquired by "delete_volume" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c07b8-8467-4988-95d7-5cd2198fd3a5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:15 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c Sep 01 00:36:15 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:15 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c Sep 01 00:36:15 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:15 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c" returned: 0 in 0.389s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11566fca-15f3-44d1-b749-2ead55674f9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd0567-f295-4c65-bae5-869009602fe6]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:15 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:15 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c Sep 01 00:36:15 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:15 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b Sep 01 00:36:15 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:15 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "cinder-quobyte-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c" released by "delete_volume" :: held 0.701s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Created reservations ['e5b2d09f-222f-45e5-9562-281e85a1f175', '9d410230-7d58-497a-8eee-8f007840f218', '36ad4b60-6a1f-46b9-91fe-e357fde7c70e', 'b03a6039-7beb-4db0-af8f-1505fbd05afe'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:15 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b" returned: 0 in 0.387s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:15 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c Sep 01 00:36:15 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:15 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:16 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:16 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:16 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.272s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Deleted volume successfully. Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-8ca14212-372f-42fd-8e3e-1daf9e41f4d7 tempest-ProjectReaderTests-888394594 None] Lock "cinder-ed8a50e1-7dc8-4293-ae0b-3ccb5fd28d4c-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:16 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c" returned: 0 in 0.395s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:16 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c Sep 01 00:36:16 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:16 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b.9d2d87d4-0130-42b1-afdf-0f1b141f666c" returned: 0 in 0.275s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-9d2d87d4-0130-42b1-afdf-0f1b141f666c" released by "_delete_snapshot" :: held 1.559s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" released by "delete_snapshot" :: held 1.587s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Created reservations ['93ffc9b2-3814-4214-b258-e2f6edd13088', '3e75d66e-f250-402e-a46a-f8103c38ded9', '99bcb73d-e279-4288-aa7b-e6ceeea7b263', '66fb1c6b-b244-4b5f-8cf3-70604be2601f'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:16 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d06086c7-32cd-4171-bfe3-eb9bd541a283 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-9d2d87d4-0130-42b1-afdf-0f1b141f666c-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-11566fca-15f3-44d1-b749-2ead55674f9b-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-11566fca-15f3-44d1-b749-2ead55674f9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" acquired by "delete_volume" :: waited 0.025s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2e343b-7ad5-4994-b32c-ce7aa9e5ac8f]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:17 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b Sep 01 00:36:17 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:17 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b" returned: 0 in 0.386s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:17 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b Sep 01 00:36:17 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:17 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-11566fca-15f3-44d1-b749-2ead55674f9b" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-11566fca-15f3-44d1-b749-2ead55674f9b" released by "delete_volume" :: held 0.748s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Created reservations ['9c846f63-45e0-4865-9ca9-0e2aa42ff27a', '322ecd9a-5b72-40cc-ab46-d658e90ac37c', '31d19576-e0e3-4d7b-8990-fb6947143b4c', 'ed38162b-59dd-4a9c-8bdc-76c1422bac89'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:18 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:18 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:18 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.281s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:18 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-a95e25d1-018d-4733-97ab-f5c0311be693 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-11566fca-15f3-44d1-b749-2ead55674f9b-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (85f284cd-5d96-4be1-a296-95cf7788bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2056e189-7c39-4cc3-8456-130cb803e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2056e189-7c39-4cc3-8456-130cb803e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902339729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ea3323-c3f3-4162-947a-b5bdfd7081f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:19Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc327bea-afed-40e6-a7ab-d39b3d0cd6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc327bea-afed-40e6-a7ab-d39b3d0cd6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8d8d98-4f7d-43f2-a849-bdaffbaacf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8d8d98-4f7d-43f2-a849-bdaffbaacf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ea3323-c3f3-4162-947a-b5bdfd7081f7', 'volume_name': 'volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce408112-f291-4fff-bf4b-1f5c6b47dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce408112-f291-4fff-bf4b-1f5c6b47dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367623d-8d4f-4da7-8f32-633d466f39d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:18 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Volume 29ea3323-c3f3-4162-947a-b5bdfd7081f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7', 'volume_size': 1} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902339729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ea3323-c3f3-4162-947a-b5bdfd7081f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:19Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Creating volume 29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:18 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:18 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:19 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 1073741824 Sep 01 00:36:19 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:19 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 1073741824" returned: 0 in 0.413s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:19 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 Sep 01 00:36:19 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:19 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7" returned: 0 in 0.239s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7367623d-8d4f-4da7-8f32-633d466f39d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24d7491-98d9-42a0-8899-b17baeba7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:19 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Volume volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 (29ea3323-c3f3-4162-947a-b5bdfd7081f7): created successfully Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24d7491-98d9-42a0-8899-b17baeba7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:19 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (85f284cd-5d96-4be1-a296-95cf7788bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:19 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-791e6610-08aa-4b30-85a2-e8fead9f6f4c tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 70b059c3-2732-4988-9cd4-eb8df6a17b31 of volume 29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[16104d6f-e0f0-499f-8897-29d24876e653]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:20 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 Sep 01 00:36:20 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:20 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7" returned: 0 in 0.366s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:20 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 1G Sep 01 00:36:20 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:20 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 1G" returned: 0 in 0.389s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:20 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:20 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 Sep 01 00:36:20 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:21 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31" returned: 0 in 0.300s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:21 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 is being set with open permissions: ugo+rw Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:21 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 Sep 01 00:36:21 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:21 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31" returned: 0 in 0.245s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:21 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info Sep 01 00:36:21 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:21 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info" returned: 0 in 0.274s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:21 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info is being set with open permissions: ugo+rw Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:21 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info Sep 01 00:36:21 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:21 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.info" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=179,cinder:UPDATE=235,cinder:INSERT=60,cinder:DELETE=15 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:36:21 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=171,cinder:UPDATE=229,cinder:DELETE=25,cinder:INSERT=62 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:36:21 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-b8688c3d-e70f-46d8-b44f-050288571486 tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-70b059c3-2732-4988-9cd4-eb8df6a17b31-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-70b059c3-2732-4988-9cd4-eb8df6a17b31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-70b059c3-2732-4988-9cd4-eb8df6a17b31" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-70b059c3-2732-4988-9cd4-eb8df6a17b31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 70b059c3-2732-4988-9cd4-eb8df6a17b31 of volume 29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[2584468d-88e7-48f3-9dda-5bd814760aa4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:22 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 Sep 01 00:36:22 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:22 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[604835ff-f80c-4c44-82b2-9edda1fcabe3]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:22 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 Sep 01 00:36:22 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:23 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:23 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 Sep 01 00:36:23 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:23 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31" returned: 0 in 0.336s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:23 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31 Sep 01 00:36:23 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:23 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7.70b059c3-2732-4988-9cd4-eb8df6a17b31" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-70b059c3-2732-4988-9cd4-eb8df6a17b31" released by "_delete_snapshot" :: held 1.398s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" released by "delete_snapshot" :: held 1.421s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Created reservations ['3e3298cd-abc4-4767-808a-e1786922f831', 'b3fb610c-da0d-48ec-a8ba-cf9f70610673', 'cc93b561-6b69-42dd-b0d8-8e9c308f5042', 'c7128d64-26e6-4e66-aca0-eb0d1787f885'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:23 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e7c8f090-c715-4f91-9d5b-ac2f462be809 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-70b059c3-2732-4988-9cd4-eb8df6a17b31-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-29ea3323-c3f3-4162-947a-b5bdfd7081f7-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "cinder-29ea3323-c3f3-4162-947a-b5bdfd7081f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[84623d21-a2fc-4209-af4e-d284c5797306]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:24 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 Sep 01 00:36:24 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:24 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7" returned: 0 in 0.371s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:24 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7 Sep 01 00:36:24 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:25 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-29ea3323-c3f3-4162-947a-b5bdfd7081f7" returned: 0 in 0.269s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-29ea3323-c3f3-4162-947a-b5bdfd7081f7" released by "delete_volume" :: held 0.696s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Created reservations ['77001df6-cd0a-4e89-bade-ecfc459b23de', 'a1407f2c-e462-44dd-adcf-265e6f03f604', '920d55c8-d9c7-4a1b-af30-a7553f1efc5d', '986f181d-72b2-4331-a240-0ce4e7f36729'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:25 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:25 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:25 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0a3cc233-82d6-465c-862e-5a6d21fbdc9f tempest-ProjectMemberTests-1194111758 None] Lock "cinder-29ea3323-c3f3-4162-947a-b5bdfd7081f7-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (6b5abf79-fc1c-4a73-97cc-3c9719e95934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae84edb-9b0e-4e6b-946e-fa2ad73e077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae84edb-9b0e-4e6b-946e-fa2ad73e077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681905760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c975263e-3abf-4f1d-b411-58efe0e0a9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:26Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7779248b-85d4-42d1-ac07-0088d8bdaa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7779248b-85d4-42d1-ac07-0088d8bdaa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ae3ae5-b4ef-40e2-87f2-8a32d78a90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ae3ae5-b4ef-40e2-87f2-8a32d78a90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c975263e-3abf-4f1d-b411-58efe0e0a9d7', 'volume_name': 'volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d014c26e-4084-4088-8311-e67796308503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d014c26e-4084-4088-8311-e67796308503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7041244b-34e1-41a6-a4d4-9b5099ef660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Volume c975263e-3abf-4f1d-b411-58efe0e0a9d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7', 'volume_size': 1} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681905760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c975263e-3abf-4f1d-b411-58efe0e0a9d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:26Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Creating volume c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:26 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:26 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 1073741824 Sep 01 00:36:26 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:26 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 1073741824" returned: 0 in 0.502s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:26 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 Sep 01 00:36:26 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:26 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7" returned: 0 in 0.259s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7041244b-34e1-41a6-a4d4-9b5099ef660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4885bcc-8e55-40f9-b65e-dd68677f7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:26 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Volume volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 (c975263e-3abf-4f1d-b411-58efe0e0a9d7): created successfully Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4885bcc-8e55-40f9-b65e-dd68677f7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:26 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (6b5abf79-fc1c-4a73-97cc-3c9719e95934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:27 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-338470c4-381d-4680-bff9-dafe853fecc4 tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot e2044abb-2580-42d4-96d1-5f5d34422f21 of volume c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[f616c39f-0d5b-4ce2-8d2f-8eac1dfa1f82]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:28 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 Sep 01 00:36:28 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:28 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7" returned: 0 in 0.377s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:28 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 1G Sep 01 00:36:28 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:29 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 1G" returned: 0 in 0.409s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:29 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 Sep 01 00:36:29 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:29 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21" returned: 0 in 0.298s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:29 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 is being set with open permissions: ugo+rw Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:29 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 Sep 01 00:36:29 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:29 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21" returned: 0 in 0.253s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:29 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info Sep 01 00:36:29 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:29 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:29 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info is being set with open permissions: ugo+rw Sep 01 00:36:29 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:29 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info Sep 01 00:36:29 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:30 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.info" returned: 0 in 0.244s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:30 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8f288e22-5ac3-4d72-98b9-10258456059a tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-e2044abb-2580-42d4-96d1-5f5d34422f21-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-e2044abb-2580-42d4-96d1-5f5d34422f21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-e2044abb-2580-42d4-96d1-5f5d34422f21" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-e2044abb-2580-42d4-96d1-5f5d34422f21" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot e2044abb-2580-42d4-96d1-5f5d34422f21 of volume c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8de1e-8392-4680-98e2-54c78402e790]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:30 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 Sep 01 00:36:30 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:30 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21" returned: 0 in 0.357s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[4881cd7a-e418-48d7-8dd5-4ec3ca5294c5]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:30 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:30 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 Sep 01 00:36:30 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:31 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7" returned: 0 in 0.359s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:31 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 Sep 01 00:36:31 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:31 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21" returned: 0 in 0.335s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:31 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21 Sep 01 00:36:31 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:31 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7.e2044abb-2580-42d4-96d1-5f5d34422f21" returned: 0 in 0.265s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-e2044abb-2580-42d4-96d1-5f5d34422f21" released by "_delete_snapshot" :: held 1.407s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" released by "delete_snapshot" :: held 1.432s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Created reservations ['0f5b0ef5-0f9b-4e37-a514-0902722b4a7f', 'd63217c7-59b5-4009-b2ec-cf0484b1e4f9', '1ce570a4-8999-45b5-9b9a-c605ea5385da', '0b39daed-36b9-4e75-a769-33b5a43b29e0'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:31 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:31 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-858734f1-6243-4677-aec6-9ca8c4fff88a tempest-ProjectMemberTests-1194111758 None] Lock "cinder-e2044abb-2580-42d4-96d1-5f5d34422f21-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-c975263e-3abf-4f1d-b411-58efe0e0a9d7-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-c975263e-3abf-4f1d-b411-58efe0e0a9d7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" acquired by "delete_volume" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d202812e-5e4b-4683-bc79-f5b543be9aa4]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:32 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 Sep 01 00:36:32 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:32 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:32 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7" returned: 0 in 0.358s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:33 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7 Sep 01 00:36:33 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:33 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-c975263e-3abf-4f1d-b411-58efe0e0a9d7" returned: 0 in 0.250s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-c975263e-3abf-4f1d-b411-58efe0e0a9d7" released by "delete_volume" :: held 0.668s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Created reservations ['4dade4bf-2537-4b1f-bb43-9dce0e8c34ea', 'bcbb5454-d610-4db4-b2e4-835d7d9ed2b2', 'e95907c0-a47c-455c-a35b-cc932e8b7f5c', 'abf02566-ff29-4d28-aa77-18d34d966152'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:33 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:33 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:33 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.260s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:33 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:33 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-640b78c4-9c55-48c3-b0be-a9b29991b720 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-c975263e-3abf-4f1d-b411-58efe0e0a9d7-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (fd93347c-acb1-461b-b22b-54d03a334686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371b0be7-0487-4e42-ae9d-7977af5d5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371b0be7-0487-4e42-ae9d-7977af5d5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106349592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c241d-65f7-49cb-94af-bf96d1a52611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:34Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20e27b2-38a1-4596-9003-a2e560da45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20e27b2-38a1-4596-9003-a2e560da45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b2742-4b54-42a8-91a4-2838b0c094a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b2742-4b54-42a8-91a4-2838b0c094a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8c241d-65f7-49cb-94af-bf96d1a52611', 'volume_name': 'volume-1c8c241d-65f7-49cb-94af-bf96d1a52611', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d13880-9b2e-47d9-bf37-1258227e8654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d13880-9b2e-47d9-bf37-1258227e8654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9667940a-17f0-4f2b-96c3-595ccf1a01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Volume 1c8c241d-65f7-49cb-94af-bf96d1a52611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8c241d-65f7-49cb-94af-bf96d1a52611', 'volume_size': 1} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106349592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c241d-65f7-49cb-94af-bf96d1a52611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:34Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Creating volume 1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:34 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:34 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 1073741824 Sep 01 00:36:34 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:34 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 1073741824" returned: 0 in 0.437s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:34 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 Sep 01 00:36:34 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:34 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611" returned: 0 in 0.265s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9667940a-17f0-4f2b-96c3-595ccf1a01f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8c241d-65f7-49cb-94af-bf96d1a52611', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:34 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3178c1d-213e-4b96-92e5-e996f662761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:34 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Volume volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 (1c8c241d-65f7-49cb-94af-bf96d1a52611): created successfully Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3178c1d-213e-4b96-92e5-e996f662761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (fd93347c-acb1-461b-b22b-54d03a334686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:35 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-19f6569a-28e7-463c-b596-289baca41e6e tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 44cfb0b0-598c-48aa-a084-4733e6853f0a of volume 1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b583fa5-b65a-43c7-ba31-cbe44cac342a]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:35 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 Sep 01 00:36:35 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:35 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:35 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:35 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a 1G Sep 01 00:36:35 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:36 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a 1G" returned: 0 in 0.397s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:36 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a Sep 01 00:36:36 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:36 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a" returned: 0 in 0.312s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:36 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a is being set with open permissions: ugo+rw Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:36 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a Sep 01 00:36:36 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:36 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:36 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info Sep 01 00:36:36 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:36 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info" returned: 0 in 0.257s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:36 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info is being set with open permissions: ugo+rw Sep 01 00:36:36 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:36 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info Sep 01 00:36:36 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:37 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.info" returned: 0 in 0.257s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:37 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-97fa9429-e8be-48ee-aac1-ead9e86872da tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-44cfb0b0-598c-48aa-a084-4733e6853f0a-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-44cfb0b0-598c-48aa-a084-4733e6853f0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-44cfb0b0-598c-48aa-a084-4733e6853f0a" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-44cfb0b0-598c-48aa-a084-4733e6853f0a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 44cfb0b0-598c-48aa-a084-4733e6853f0a of volume 1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7cda4-d910-41cd-9c23-c985702540a8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:37 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a Sep 01 00:36:37 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:37 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a" returned: 0 in 0.350s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8c241d-65f7-49cb-94af-bf96d1a52611(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc1b890-a0ce-4f4b-8cc1-23a0475d96f8]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:37 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:38 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 Sep 01 00:36:38 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:38 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611" returned: 0 in 0.361s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:38 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a Sep 01 00:36:38 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:38 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a" returned: 0 in 0.344s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:38 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a Sep 01 00:36:38 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:38 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611.44cfb0b0-598c-48aa-a084-4733e6853f0a" returned: 0 in 0.253s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-44cfb0b0-598c-48aa-a084-4733e6853f0a" released by "_delete_snapshot" :: held 1.405s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:38 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" released by "delete_snapshot" :: held 1.429s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Created reservations ['403943cd-2269-487e-b820-3ea7decf450d', 'd0bd7e97-e5a1-49e0-b683-6e34e90a412e', '7d084942-8b10-44a0-b855-201605d171a5', 'e0590056-eec7-4832-ae5b-5705f044447b'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:39 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-d17560ee-e1fe-44b7-8737-ef3225c8bef3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-44cfb0b0-598c-48aa-a084-4733e6853f0a-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-1c8c241d-65f7-49cb-94af-bf96d1a52611-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-1c8c241d-65f7-49cb-94af-bf96d1a52611-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" acquired by "delete_volume" :: waited 0.013s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4b4595-5ca0-45a8-b646-7fc4e1f10c0b]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:39 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:39 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 Sep 01 00:36:39 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:40 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611" returned: 0 in 0.358s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:40 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611 Sep 01 00:36:40 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:40 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-1c8c241d-65f7-49cb-94af-bf96d1a52611" returned: 0 in 0.243s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-1c8c241d-65f7-49cb-94af-bf96d1a52611" released by "delete_volume" :: held 0.657s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Created reservations ['f2569eb7-92b0-4180-bd3f-52d951b1be48', 'e6504ec2-b523-48a1-bd87-a41ff81472e7', '72e107d4-ed15-4822-81b8-2ea2310a70e6', 'b90cd440-f60b-4d1b-af24-d5e10f4d5f85'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:40 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:40 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:40 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:40 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:40 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-6eae1622-a55b-4ee0-aa9c-04854eda94a3 tempest-ProjectMemberTests-1194111758 None] Lock "cinder-1c8c241d-65f7-49cb-94af-bf96d1a52611-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (8c09872d-7793-4ff3-95f0-80925ad05a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d3585b-e158-4e08-8b60-5862b64cf786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d3585b-e158-4e08-8b60-5862b64cf786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579486931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be940a26-2a8a-4a7f-851b-a14e8b7aca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:41Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1e32d0-5c45-4f4d-b6f3-3ddf31f61a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1e32d0-5c45-4f4d-b6f3-3ddf31f61a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d6a3b0-bb08-4748-994d-ec632cd4e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d6a3b0-bb08-4748-994d-ec632cd4e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be940a26-2a8a-4a7f-851b-a14e8b7aca4d', 'volume_name': 'volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f2bf5d-d9a0-4b8e-9295-509ed6d341ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f2bf5d-d9a0-4b8e-9295-509ed6d341ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6465dae-6e63-4ae2-8280-1dd12f35162f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:41 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Volume be940a26-2a8a-4a7f-851b-a14e8b7aca4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d', 'volume_size': 1} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579486931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be940a26-2a8a-4a7f-851b-a14e8b7aca4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e949fba3e08445db9f9f354a2b0af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:36:41Z,use_quota=True,user_id='9274671d29204522af7745b002dfc04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Creating volume be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:36:41 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:41 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d 1073741824 Sep 01 00:36:41 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:41 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d 1073741824" returned: 0 in 0.433s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:41 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:41 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d Sep 01 00:36:41 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:42 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" returned: 0 in 0.241s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6465dae-6e63-4ae2-8280-1dd12f35162f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e748b8b-51dd-489c-94d2-6d7ee8325da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:36:42 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Volume volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d (be940a26-2a8a-4a7f-851b-a14e8b7aca4d): created successfully Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e748b8b-51dd-489c-94d2-6d7ee8325da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Flow 'volume_create_manager' (8c09872d-7793-4ff3-95f0-80925ad05a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:36:42 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-8aa773d0-e8a7-4a99-b3ba-5c7d37b014b0 tempest-ProjectMemberTests-1194111758 None] Created volume successfully. Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Creating offline snapshot 3730dfff-f07d-47ce-9cb2-63c427cea15f of volume be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a553f9-ef78-442d-a82a-e57e11bfb996]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:42 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d Sep 01 00:36:42 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:42 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:42 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:42 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f 1G Sep 01 00:36:42 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:43 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f 1G" returned: 0 in 0.412s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:43 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f Sep 01 00:36:43 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:43 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:43 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f is being set with open permissions: ugo+rw Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:43 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f Sep 01 00:36:43 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:43 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f" returned: 0 in 0.244s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:43 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:43 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info Sep 01 00:36:43 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:44 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info" returned: 0 in 0.284s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:44 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info is being set with open permissions: ugo+rw Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:44 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info Sep 01 00:36:44 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:44 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.info" returned: 0 in 0.292s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:44 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-dce8c8e5-599d-47b4-8079-1fba092c2d34 tempest-ProjectMemberTests-1194111758 None] Create snapshot completed successfully Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-3730dfff-f07d-47ce-9cb2-63c427cea15f-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-3730dfff-f07d-47ce-9cb2-63c427cea15f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-3730dfff-f07d-47ce-9cb2-63c427cea15f" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-3730dfff-f07d-47ce-9cb2-63c427cea15f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Deleting offline snapshot 3730dfff-f07d-47ce-9cb2-63c427cea15f of volume be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] snapshot_file for this snap is: volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e70d7a-a1ad-4281-822d-73e759df785e]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:44 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:44 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f Sep 01 00:36:44 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:45 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f" returned: 0 in 0.385s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f8bd7-b725-4174-b0e3-41a6d3256363]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:45 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d Sep 01 00:36:45 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:45 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" returned: 0 in 0.374s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:45 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f Sep 01 00:36:45 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:45 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f" returned: 0 in 0.381s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:45 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:45 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f Sep 01 00:36:45 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:46 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d.3730dfff-f07d-47ce-9cb2-63c427cea15f" returned: 0 in 0.246s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-3730dfff-f07d-47ce-9cb2-63c427cea15f" released by "_delete_snapshot" :: held 1.474s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" released by "delete_snapshot" :: held 1.497s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Created reservations ['e620edfb-6380-445b-a0e9-fb396fcaa20e', 'e56427eb-1896-4a8d-a616-974cd7c3c9b8', '80c009cb-9fec-4563-af85-84093aff8067', '74641175-1504-4860-a48e-4b7fd1d5e350'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:46 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Delete snapshot completed successfully. Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-e4f273ce-5f07-429e-9405-70ab2911d07b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-3730dfff-f07d-47ce-9cb2-63c427cea15f-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-be940a26-2a8a-4a7f-851b-a14e8b7aca4d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-be940a26-2a8a-4a7f-851b-a14e8b7aca4d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a9bde-be92-426f-8763-b0591efecc66]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:36:46 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:47 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d Sep 01 00:36:47 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:47 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" returned: 0 in 0.367s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:47 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d Sep 01 00:36:47 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:47 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" returned: 0 in 0.256s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-quobyte-be940a26-2a8a-4a7f-851b-a14e8b7aca4d" released by "delete_volume" :: held 0.678s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Created reservations ['525a0899-d480-4238-830d-715acaf21745', '2865558c-b926-4292-9d86-37fee32c66f9', 'c7e51315-5fb2-477f-9463-909e07f46819', '8fc5b2de-2150-4ee8-b1e6-d0a26669e97e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:36:47 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:36:47 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:36:47 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.251s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:36:47 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Deleted volume successfully. Sep 01 00:36:47 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-0bb2d20b-34fc-47d4-9b97-509e55a36f7b tempest-ProjectMemberTests-1194111758 None] Lock "cinder-be940a26-2a8a-4a7f-851b-a14e8b7aca4d-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:06 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:DELETE=3,cinder:SELECT=49,cinder:INSERT=22,cinder:UPDATE=72 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:37:06 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=55,cinder:INSERT=16,cinder:UPDATE=64,cinder:DELETE=8 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Flow 'volume_create_manager' (f6a8a41c-662e-4490-b04b-ddc7ae29100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce653ac2-2350-485c-a00b-b69c522a3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce653ac2-2350-485c-a00b-b69c522a3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2110675559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f185ddf-e866-453a-88ec-cce0e9ed0015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bf8e848034317b16139f8e4466998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:37:12Z,use_quota=True,user_id='a50b7681b1614da3b7afc80ad2adf91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e1a71b-6126-41ab-a80b-713ef9711feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e1a71b-6126-41ab-a80b-713ef9711feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c373725-faf3-45b5-823e-7b1996c60805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c373725-faf3-45b5-823e-7b1996c60805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f185ddf-e866-453a-88ec-cce0e9ed0015', 'volume_name': 'volume-6f185ddf-e866-453a-88ec-cce0e9ed0015', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1170a8-1425-417b-a06b-f341b49b9f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1170a8-1425-417b-a06b-f341b49b9f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbe935c-5bf1-4f6e-955d-2218db792fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:11 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Volume 6f185ddf-e866-453a-88ec-cce0e9ed0015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f185ddf-e866-453a-88ec-cce0e9ed0015', 'volume_size': 1} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2110675559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f185ddf-e866-453a-88ec-cce0e9ed0015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bf8e848034317b16139f8e4466998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:37:12Z,use_quota=True,user_id='a50b7681b1614da3b7afc80ad2adf91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)}" {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Creating volume 6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:37:11 devstack cinder-volume[87803]: INFO cinder.volume.drivers.remotefs [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] casted to osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 Sep 01 00:37:11 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 1073741824 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:11 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 1073741824 Sep 01 00:37:11 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:12 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 1073741824" returned: 0 in 0.441s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:12 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:12 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:12 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.305s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'} {{(pid=87803) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbe935c-5bf1-4f6e-955d-2218db792fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f185ddf-e866-453a-88ec-cce0e9ed0015', 'volume_size': 1}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bdb77e-44c8-470d-89ac-d6e9ab20abf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:12 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Volume volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 (6f185ddf-e866-453a-88ec-cce0e9ed0015): created successfully Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bdb77e-44c8-470d-89ac-d6e9ab20abf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:12 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Flow 'volume_create_manager' (f6a8a41c-662e-4490-b04b-ddc7ae29100e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:37:12 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7028d13e-df90-4a39-91b1-6c0ba184f149 tempest-SnapshotDependencyTests-809810602 None] Created volume successfully. Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:13 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:37:13 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:13 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.269s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG oslo_service.periodic_task [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] Running periodic task VolumeManager._thread_info {{(pid=87803) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread count: 28 {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 00:37:13 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-43787633-3cbf-4dd5-875a-13aca34411be None None] thread info: [<_MainThread(MainThread, started 124938387333248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87803) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Creating offline snapshot 1ebb7324-e936-4694-a883-78811c337aaa of volume 6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[641efb3b-6d8f-4b94-b9f0-2c4e2248acf7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:14 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:14 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:14 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.372s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:14 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa 1G {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:14 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa 1G Sep 01 00:37:14 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:15 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa 1G" returned: 0 in 0.400s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:15 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:15 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:15 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 -F qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.302s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:15 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa is being set with open permissions: ugo+rw Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:15 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:15 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:15 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.248s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:15 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info Sep 01 00:37:15 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:15 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info" returned: 0 in 0.263s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:15 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info is being set with open permissions: ugo+rw Sep 01 00:37:15 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:15 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info Sep 01 00:37:15 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:16 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.info" returned: 0 in 0.241s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:16 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-944a0e8e-8d95-4252-b659-6520b9424d6f tempest-SnapshotDependencyTests-809810602 None] Create snapshot completed successfully Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87803) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Flow 'volume_create_manager' (64090527-bf34-4f9c-826d-2e4b6beb9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fcf962-96c9-45f0-b834-fbea5b43a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fcf962-96c9-45f0-b834-fbea5b43a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T22:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef75c7b-2c4a-4d86-aa19-03ad9405295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bf8e848034317b16139f8e4466998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T22:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ebb7324-e936-4694-a883-78811c337aaa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T22:37:17Z,use_quota=True,user_id='a50b7681b1614da3b7afc80ad2adf91d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62f47196-ee91-4ae7-b741-cd779d60fb71),volume_type_id=62f47196-ee91-4ae7-b741-cd779d60fb71)' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e0f6f5-a7ec-4266-a4a3-dcacf79db3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e0f6f5-a7ec-4266-a4a3-dcacf79db3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08baebe2-789b-40a9-9a58-be7866403671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:16 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08baebe2-789b-40a9-9a58-be7866403671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aef75c7b-2c4a-4d86-aa19-03ad9405295d', 'volume_name': 'volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d', 'volume_size': 1, 'snapshot_id': '1ebb7324-e936-4694-a883-78811c337aaa'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08591220-3d70-4c12-b4ad-80ff3d593198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08591220-3d70-4c12-b4ad-80ff3d593198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2350f305-45d1-4343-9b75-9532b0d5a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:17 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Volume aef75c7b-2c4a-4d86-aa19-03ad9405295d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d', 'volume_size': 1, 'snapshot_id': '1ebb7324-e936-4694-a883-78811c337aaa'} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa-aef75c7b-2c4a-4d86-aa19-03ad9405295d" by "_create_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa-aef75c7b-2c4a-4d86-aa19-03ad9405295d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Creating volume aef75c7b-2c4a-4d86-aa19-03ad9405295d from snapshot 1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Selected osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6 as target Quobyte volume. {{(pid=87803) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" by "_copy_volume_from_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] snapshot: 1ebb7324-e936-4694-a883-78811c337aaa, volume: aef75c7b-2c4a-4d86-aa19-03ad9405295d, {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f8d683-8d34-48a5-9740-823cd4094c69]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:17 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:17 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:17 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.375s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f185ddf-e866-453a-88ec-cce0e9ed0015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f4b35-ce70-43c4-a79f-dfdcc54c27da]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:17 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:17 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:17 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.375s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Creating direct copy from snapshot {{(pid=87803) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG cinder.utils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Path /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d not found in is_blk_device check {{(pid=87803) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 01 00:37:17 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:17 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d Sep 01 00:37:17 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:21 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d" returned: 0 in 4.101s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:21 devstack cinder-volume[87803]: DEBUG cinder.image.image_utils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Image conversion details: src /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d {{(pid=87803) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 00:37:21 devstack cinder-volume[87803]: INFO cinder.image.image_utils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Converted 1024.00 MB image at 249.54 MB/s Sep 01 00:37:21 devstack cinder-volume[87803]: WARNING cinder.volume.drivers.remotefs [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d is being set with open permissions: ugo+rw Sep 01 00:37:21 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:22 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d Sep 01 00:37:22 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:22 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" released by "_copy_volume_from_snapshot" :: held 5.175s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa-aef75c7b-2c4a-4d86-aa19-03ad9405295d" released by "_create_volume_from_snapshot" :: held 5.277s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.294s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2350f305-45d1-4343-9b75-9532b0d5a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d', 'volume_size': 1, 'snapshot_id': '1ebb7324-e936-4694-a883-78811c337aaa'}' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdf70fe-b8fd-4b51-9cd2-057807356fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 00:37:22 devstack cinder-volume[87803]: INFO cinder.volume.flows.manager.create_volume [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Volume volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d (aef75c7b-2c4a-4d86-aa19-03ad9405295d): created successfully Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdf70fe-b8fd-4b51-9cd2-057807356fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87803) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 00:37:22 devstack cinder-volume[87803]: DEBUG cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Flow 'volume_create_manager' (64090527-bf34-4f9c-826d-2e4b6beb9007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87803) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 00:37:22 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-9fcd259f-a783-4755-9214-8a6bc0bff2f0 tempest-SnapshotDependencyTests-809810602 None] Created volume successfully. Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-1ebb7324-e936-4694-a883-78811c337aaa-delete_snapshot" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-1ebb7324-e936-4694-a883-78811c337aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" by "delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa" by "_delete_snapshot" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Deleting offline snapshot 1ebb7324-e936-4694-a883-78811c337aaa of volume 6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] snapshot_file for this snap is: volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d550b-e544-459c-a527-d5cfa9c1e190]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:23 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:23 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:23 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:24 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.354s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.remotefs [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f185ddf-e866-453a-88ec-cce0e9ed0015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87803) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a6edf9-c320-43ac-9b2c-97839e9dcbf7]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:24 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:24 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:24 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.513s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:24 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:24 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:24 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.340s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:24 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:24 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa Sep 01 00:37:24 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:25 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015.1ebb7324-e936-4694-a883-78811c337aaa" returned: 0 in 0.246s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-1ebb7324-e936-4694-a883-78811c337aaa" released by "_delete_snapshot" :: held 1.542s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" released by "delete_snapshot" :: held 1.564s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Created reservations ['bd944120-6175-4f73-a078-1d716757ed2a', '01cb4f66-7458-45f4-ae42-99df7d20ddc4', 'ca3762dd-bcca-4903-839e-6c8fff721f73', '409bc8b9-c976-4b2b-adab-4f1d5421f10e'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:37:25 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Delete snapshot completed successfully. Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-79fc8dc8-83a7-4f07-ab3d-d9903c5eeea7 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-1ebb7324-e936-4694-a883-78811c337aaa-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-6f185ddf-e866-453a-88ec-cce0e9ed0015-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-6f185ddf-e866-453a-88ec-cce0e9ed0015-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" acquired by "delete_volume" :: waited 0.016s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a472b4-732a-4931-9eb5-7716d24df267]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:25 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:25 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:25 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:26 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.408s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:26 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015 Sep 01 00:37:26 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:26 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-6f185ddf-e866-453a-88ec-cce0e9ed0015" returned: 0 in 0.261s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-6f185ddf-e866-453a-88ec-cce0e9ed0015" released by "delete_volume" :: held 0.725s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Created reservations ['eb717dcd-a528-4a48-84bc-9c19245d6db5', '533175f3-ed70-4a02-bb67-475e69eda9b5', '5c463507-02e5-4ef1-b127-9242eb0637a2', 'b35f249d-87f2-41a5-bf4a-7c0496aa5bab'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:26 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:37:26 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:26 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.255s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:37:26 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Deleted volume successfully. Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-aef75c7b-2c4a-4d86-aa19-03ad9405295d-delete_volume" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-abb0c614-30f1-42bd-9fab-f3859cbcb2c1 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-6f185ddf-e866-453a-88ec-cce0e9ed0015-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-aef75c7b-2c4a-4d86-aa19-03ad9405295d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:26 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" by "delete_volume" {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" acquired by "delete_volume" :: waited 0.012s {{(pid=87803) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo.privsep.daemon [-] privsep: reply[423ac262-a9c6-4ca4-a123-a0942a27e179]: (4, 'qcow2') {{(pid=89587) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:27 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d Sep 01 00:37:27 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:27 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d" returned: 0 in 0.352s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:27 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d Sep 01 00:37:27 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:27 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f/volume-aef75c7b-2c4a-4d86-aa19-03ad9405295d" returned: 0 in 0.247s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-quobyte-aef75c7b-2c4a-4d86-aa19-03ad9405295d" released by "delete_volume" :: held 0.638s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG cinder.quota [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Created reservations ['473cad50-de50-421e-8904-bf6bd0097937', 'a2bf71a6-2b04-4654-be56-6f7ff322493c', '87509bef-af5d-4654-9375-41947c33f318', '3a71dd59-d976-4fa6-ae1b-6f409bdbcdd2'] {{(pid=87803) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6': None} {{(pid=87803) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG cinder.volume.drivers.quobyte [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-621877dc-6257-4f11-b497-3288a37299a6'] {{(pid=87803) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.lockutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87803) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 00:37:27 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 00:37:27 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f Sep 01 00:37:27 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 00:37:28 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 01 00:37:28 devstack cinder-volume[87803]: DEBUG oslo_concurrency.processutils [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a52f0d759123d216a1782f6c3527cf6f" returned: 0 in 0.268s {{(pid=87803) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 00:37:28 devstack cinder-volume[87803]: DEBUG cinder.manager [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Notifying Schedulers of capabilities ... {{(pid=87803) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 00:37:28 devstack cinder-volume[87803]: INFO cinder.volume.manager [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Deleted volume successfully. Sep 01 00:37:28 devstack cinder-volume[87803]: DEBUG cinder.coordination [None req-7a6b86b2-aac7-4ef2-a9f1-3de38757b2e4 tempest-SnapshotDependencyTests-809810602 None] Lock "cinder-aef75c7b-2c4a-4d86-aa19-03ad9405295d-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87803) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 00:37:37 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:UPDATE=32,cinder:SELECT=27,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 00:37:38 devstack cinder-volume[87803]: DEBUG dbcounter [-] [87803] Writing DB stats cinder:SELECT=22,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87803) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}